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PREFACE 



Reporting both the successes and failures of a program 
is an ethical as well as contractual obligation of research 
and development. It will be apparent In the pages that follow 
that although many positive aspects of the Cashmere, Peshastin- 
Dryden Career Education Project (CEP) are reported, so, too, 
are reported a number of constrainsts and limitations. The 
reader is asked to bear in mind that this type of reporting 
represented an essential and on-going element of the project 
itself* Prom the beginning, project staff sought to incorpo- 
rate the evaluation process as an essential and useful element 
of the project. Since aspects of the project will continue 
an additional year as a dissemination model, it is hoped that 
"What follows will allow interested parties to profit from the 
collective efforts and observations of those who were involved 
in the CEP program. 

As' a research and development project, the project was 
conducted under a cooperative agreement with the Washington 
State Coordinating Council for Occupational Education and the 
Cashmere, Peshastin-Dryden schools. Several important ele- 
ments contributed to the nature of the project. These 
included! The project's goals and objectives as stated in 
the original research proposal. Conferences and negotiations 
with the Washington State Coordinating Council for Occupa- 
tional Education, input from project staff, Pragmatic adapta- 
tion to the needs of the project, and Response to the project's 
on-going discrepancy evaluation input. As a result of the 
above, several diverse functions were either implicit or 
explicit concerning the project's operation. Essentially, 
these functions were as follows t 

1. The project was developmental in nature in that it 
developed procedures and working materials suitable 
for a comprehensive career education program, grades 

Such materials and procedures were culminated 
with a transportable model including curriculum 
guides, suggested activities, resources, and 
recommended procedures for use at other localities 
seeking to implement career education into the public 
school curriculum. 

2. The project functioned as a ••process model" in that 
activities and materials were continuously being 
developed, implemented, tested, and revised through 
continuous involvement by project staff and distriot^'^-^ 
teachers. The assumption of this particular approach 
was that curriculum building should take place as a 

1 
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consequence of the efforts of Individual classroom 
teachers and should Include the activities and Ideas 
resulting from their Interpretations of the project's 
purpose • The project further assumed that a process 
of "trial and error** is tolerable In curriculum build- 
ing and that the curriculum should continuously be 
Influenced by modification ending only when the final 
product Is achieved. For want of a better term, this 
process of curriculum design could be termed an 
Experiential approach** to curriculum development, 

3. The project had a research focus In that concomitant 
to curriculum development significant changes In 
student achievement, attitudes, and behavior were 
Intended as a result of the career education 
project. 

For reference to the outcomes and products resulting from 
number one cited above, the reader should be referred to the 
final curriculum guides of the career education project ♦ These 
materials are obtainable through the Washington State Coordi- 
nating Council for Occupational Education and from the project 
office located In the Cashmere School District, Cashmere, 
Washington. The project's final evaluation report deals with 
an assessment of the project's formative and summatlve stages. 

This evaluation report was prepared by Dr. James P. Parsley, 
Jr., who served as an Independent evaluator for the Cashmere, 
Peshastln-Dryden Career Education project. The Independent 
evaluator was contracted to provide outside expertise and, to 
the extent possible, a neutral observer who would be as objec- 
tive as possible In assessing the project's worth. It Is 
hoped that the final evaluation report adds additional clarity 
to the reader's understanding of the project and that the 
report Is of assistance to the reader In making his or her 
objective Judgment based upon the facts presented. 

Appreciation is expressed to the career education staff 
who spent many hours in recording and furnishing data from 
which this report was compiled. Additionally, gratitude is 
expressed for the very excellent working relationship between 
CEP staff members and the evaluator. A high degree of profes- 
sionalism was displayed by project staff throughout the conduct 
of the project's evaluation. 
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A, Purpose of the Evaluation » Section 103.^5 of 
Title 45 of the Code of Federal Regulations, entitled 
••Research and Training, Exemplary and Curriculum Development 
Programs In Vocational Education,** provides for a third-party 
Independent evaluation at the end of each operational yeart 
In this capacity, the Intended audience for this final evalua- 
tion report Is the Vocational Education Division of the 
Washington State Coordinating Council for Occupational Educa- 
. tlon and the United States Office of Education, /Department of 
Health, Education and Welfare. Other Intended faudlences for 
the project's final evaluation are those prof eaislonal educators 
and lay citizens alike who have Interest In thei: Cashmere, 
Peshastln-Dryden Career Education Project, U.S.'Q.E. Project 
#V36l031L (Grant No. OEG-0-73-2988) . Purposes of the Indepen- 
dent third-party evaluation were as follows 1 

!• To conduct the research specified In the research 
proposal 

2. To measure progress toward the accomplishment of 
the project's amended objectives 

3. To verify data reported by project personnel and to 
assist staff .pursuant to their estimate of cost 
regarding t-rahsportablllty of each component of 
the projec^t 

^. To collect and assess appropriate data concerning 
the project's strengths, needs and weaknesses. 
Said data to serve as a basis for recommendations 
by the thjlrd-party evaluator relative to the 
project overall effectiveness and worth 

5. To provide an on-going external assessment of the 
project's operational effectiveness with recommen- 
dations which will be presented to either the 
Project Director, and/or District Superintendent, 
and/or the Washington State Coordinating Council 
for Occupational Education as requested or as 
needed In the Judgment of the third-party evaluator 



B. Rationale for the Evaluation Model. According to the 
terms of the evaluation contract, the third-party evaluator 
was charged with the execution of the evaluation plan and was 
responsible for on-site visitations, collection of data, 
preparation of specified evaluation reports, and preparation 
and administration of Instruments. In addition to conferences, 
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direct lntea:TOp:atlve, and lass formal communications, the 
evaluator vas provided with copies of relevant documents 
provided during the project's operation. Materials shared 
in this manner were as follows: 

1. Appropriate Federal regulations affecting the 
project and its evaluation, 

y 2. U.S.O.E. guidelines and policy statements, 

3. Final project proposal as approved by U.S.O.E., 

^. Pertinent correspondence between the project and 
U.S.O.E., 

5. Copy of contracts between the project and other 
technical assistance sources affecting the party 
evaluator* s work, and 

6» All reports, materials, and documents developed 
durinR the contract period. 

In performing his services, the third-party evaluator 
was an independent contractor and should reiterate that at 
no time did there exist an employer-employee relationship 
between the evaluator and the career education project • 

Since elements of the project >7ill continue as a dis- 
semination and demonstration model, it is anticipated that 
the results of the evaluation will, in several instances, 
assist the continued efforts of project staff during fiscal 
year 197^-75. Additionally, it is thought that those interested 
in implementing career education programs in the future will 
V find the final evaluation report useful in their efforts to 
J implement similar programs. It is anticipated that those 
interested in Judging the worth of the 1973-7^ CEP program 
will allow the following report to guide their decision- 
making process. 



C» The Evaluation Plan> The evaliaatlon plan can be 
depicted as having followed a discrepancy evaluation format 
which illustrates comparisons, either statistically or in- 
tuitively, concerning the degree of congruence between the 
project's intents and what was actually observed by the 
project staff, clientele, district personnel, and an inde- 
pendent evaluator. Stake authored a matrix of statements 
and data to be collected by the evaluator of an educational 
program as shown In Figure 1* 



^Robert E. Stake, *'The Countenance of Education Evalua- 
tion, Teachers College Record , Volt 68, No. 7f (April 1967) • 
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stake's matrix served as an illustrative device to assist 
project staff in conceptualizing the type of variables to be 
assessed • Evaluation, by the nature of the project's expressed 
objectives, was involved in both formative and sumsiative 
Judgments covering processes and products, operations and 
outcomes, plans and executions, etc, A time-line guiding the 
completion of the overall evaluation plan is illustrated in 
Figure 2 on the folloKlng page* 

Evaluation for the CEP program was a continuous proposi- 
tion and there existed an on-going cycle of information feed- 
back to the project's staff* In a sense, a discrepancy 
evaluation format was utilized which afforded staff the 
opportunity to redirect and Improve the project as a result 
of an on-going formative evaluation process • The intent of 
a discrepancy evaluation has been Illustrated in the litera- 
ture by Malcolm Provus. Figure 3 illustrates the sequential 
plan of events utilized in the CEP discrepancy evaluation 
format • ^ ^ 



From the above, it should be apparent that there were 
multiple expectations insofar as the evaluation process was 
concerned • In addition to providing data Illustrating the 
overall project's worth, the evaluation schema was intended 
to assist program developers (project staff) in continually 
redirecting and Improving their efforts of curriculum design 
and implementation. As it has been mentioned previously, an 
additional expectation concerned answering the research 
questions implicit in the project's objectives and to deter- 
mine whether or not the project had indeed produced signifi- 
cant changes In student behavior and knowledge related to the 
world of work and career education in general o 



Malcolm Provus, The Discrepancy Evaluation Models An 
Approach to Local Program Improvement and Development , Pitts- 
burgh Public Schools, E.S.E.A. Title I Project, 1969, PP 1-12^» 
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A. Rationale >nd Philosophy Behind the Progr>a . Cashnere, 
Peshaatln, and Dryden are three co«aunltlet located In a rural, 
geographically Isolated region In the state of Washington. The 
area Is mitlonally known for Its naln agricultural product, 
Washington Delicious apples. The nearest comranlty of size 
Is Wenatchee, Washington, with a population of 20,000. The 
comaunltles are approximately 150 alles fron Seattle, Washing- 
ton, and are bounded on all sides by Cascade Mountains end 
forests. The location of the three comiunltlea In question 
represented a major factor to local educators In their desire 
to seek Federal funds so that a comprehenslre career education 
program might be undertaken. Additional rationale for the 
CEP program came from the following problems unique to the 
Cashmere, Peshastln and Dryden communities 1 

1. Host local employment opportunities are confined 
to agriculture and to related fields. 

2. A high rate of migrant labor Is utilized due to 
seasonal occupational opportunities. 

3. The unemployment rate for 1971 In the area was 12.2 
percent and for 1972 was 12.7 percent. 

k, students attending schools In the Cashmere, Peshastln- 
Dryden schools were previously not exposed to career 
education opportunities. 

5. A limited view of the "world of work" could be 
afforded In the local communities due to their 
Isolated location, depressed economy, and small size. 

6. Approximately 70 percent of graduating seniors 
leave the area to seek employment upon completing 
school. According to follow-up survey Information, 
In past years most felt they were unprepared to 
make wise occupational choices* 

The school boards of the two districts were committed to 
the Inclusion of career education concepts Into the curriculum. 
Administrative support for the concept was extremely evident. 
As a result of the very apparent need mentioned above, staff 
members of the Cashmere, Peshastln-Dryden school districts 
developed a program proposal for a research and development 
project In career education conducted under Public Law 90-576 
Title I, Part C. The proposal was submitted to the Washington 
State Coordinating Council for Occupational Education and on 
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January 2, 1973i a demonstration, testing, and development 
site was established within the Cashmere School District 
No, 222 and Peshastin-Dryden School District No* 200* The 
project involved the two school districts cooperatively 
because both districts were served by a single superintendent 
and both districts were in the process of considering steps 
to Implement a school district consolidation* 

The educational philosophy behind the CEP program is 
essentially pragmatic in nature in that it seeks to directly 
respond to apparent needs through a comprehensive develop- 
mental career education program. A key to understanding the 
rationale behind the CEP program Is found through an examina- 
tion of the project's objectives as contained in the approved 
proposal and also in the project's amended goals and objectives* 
Although much of the rationale and philosophical background 
of the CEP project is Implicit it is of critical importance 
to understand that the rationale for the project is based 
upon wide-ranging needs and the resulting program offers a 
fairly complex design in response to those needs. 

The goals of the project were essentially derived from 
the guidelines provided by the U. Office of Education and 
the Washington State Coordinating Council for Occupational 
Education as expressed in application material sent interested 
parties wishing to apply for funds under Part C of Public 
Law 90-576 • As a result, the CEP program was designed to 
meet the needs of all children serviced by the LEA relevant 
to career awareness, orientation, exploration, work experience, 
preparation, and placement* Additionally, the project provides 
a transportable model whlr.h has had impact throughout the 
state of Washington* Prom the foregoing, it could be deduced 
that the project had a rather global intent with both short- 
range and long-range outcomes desired. 



B, Subject Matter. An interdisciplinary approach was 
utilized by project developers as they designed programs for 
grades K-12* Subject matter delineation, scope , and sequence 
are to be found in each of the several curriculum guides 
prepared at the project's completion. Figure ^ depicts an 
emphasis chart showing career clusters and the grade level 
at which that subject matter would be found • 
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Figure ^ 

CASHMERE, PESHASTIN-DRYDEN 
CAREER EDUCATION PROJECT 



CAREER EDUCATION CLUSTER— EMPHASIS CHART 
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Figure ^ 

CASHMEf^, PESHASTIN-DRYDEN 
CAREER EDUCATION PROJECT 

CAREER EDUCATION CLUSTER— EMPHASIS CHART 
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Plgrure ^ (Continued) 

CASHMERE, PESHASTIN-DRYDEN 
CAREER EDUCATION PROJECT 
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Figure 4 (Continued) 

CASHMERE, PESHASTIN-DRYDEN 
CAREER EDUCATION PROJECT 

CAREER EDUCATION CLUSTER— EMPHASIS CHART 
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Curriculum guides were organized according to unit titles 
and these are listed as folloKst 



KINDERGARTEN UNIT TITLES t 

Home and School Jobs 
Rights and Responsibilities 
Self Awareness 
Transportation 
Individual Responsibilities 
I Am Unique 

Whb Handles the Milk Before 

You Do? 
Accepting Responsibility 



Community Workers 

The Grocery Store 

I Can Cook (Thanksgiving feast) 

The Family Unit 

School Personnel 

The Grocery Store 

What Do Fathers and Mothers 

Do? 
Sharing 



GRADE ONE UNIT TITLES i 

My Father's Job 

The Postman 

Self Awareness 

School Workers 

Public Service Occupations 

Self Awareness — Physical/ 
Emotional, Social* Intel- 
lectual 



VIP (very Important person) 

Of The Week 
Public Service Occupations 
First Grade Olympics 
Janitorial Services 
Milk and Its Sy-Products 



GRADE TWO UNIT TITLES i 

Jobs In A Community 
Holland 

The Post Office and Its 

Employees 
Goods and Services 
Pood and Its Origin 
Math Skills^ and Occupations 
Sometimes Oar Hobby Becomes 

Our Job 
Relating Academic Subjects 

to Occupations 

GRADE THREE UNIT TITLES i 

The Apple Industry 
Our Coaimunlty 
The Money I Know 
Transporta 1 1 on 
Alphabetical Filing 
Rocks and Minerals 

Classification 
Counting Money 



Energy 

Developing Food Service 
Skills— A Luncheon 
The Community 
Barter Day 

Communications Skills 
Malclng and Selling A Pood 

Product 
Understanding Self and 

Others 



Transportation— Take Off 
Through the Clouds 

Investigating Different 
Careers 

Making a Corsage 

Costume Design 

Marketing and Distribution 

Write to Communicating 
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student Exchange Program 
The Family Unit and the 

World of Work 
Business and Office Occupa- 
tions 

Occupations In Construction 
Ecology — Man and His 
Environment 



A Restaurant 
Health Services 
Consumer and Homemakin^z: 

Occupations ; - 
Personal Services 
Understanding Self and Others 
The Selective Consumer 
Student Oriented Career Fair 



GRADE FIVE UNIT TITLES! 

Lax Appreciation 
Play Store^ ; 
Cooperation Among Workers 
Manufacturing Process 
Careers Based on Interests 

and/or Abilities 
Stage Play Production 
Water, the Fountain of Life 
The Salmon Industry 



GRADE SIX UNIT TITLES i 

You and Your Environment 
Library Research Skills 
The Role of Mathematics in 
Business 



Why Rules Are Necessary 
Candy Sale 

Good Grooming and the Job 
The Assembly Line 
Washington State 
Jobs of the 80 • 3 
Opportunities in Health 

Services 
Agencies of Employment and 

Employee Needs 

Library Workers 

Careers Related to Fine Arts 

and the Humanities 
Outdoor Education Camp 



GRADE SEVEN AND EIGHT UNIT TITLES: 

Personal and Social Growth 
Exploring Occupations Which 

Interest Me 
Understanding Myself 
Continental Land Survey 

System 
Matching Interests With 

Careers 

Occupations Related to Music 



Math and Transportation 

Eighth Grade Corporation 

How Come I Gotta (take. math) et 

Jobs 

Bowling: Occupation or Leisure 

Time Activity? 
Careers Related to the Riding 

Horse 



HIGH SCHOOL UNIT TITLES t 
Art > 

Careers In Art 
Biology I 

Careers Related to Biological Science 
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HIGH SCHOOL UNIT TITLES i (Continued) 
Bualnags and Office i 



Let*s Use the Telephone 
The Job Search 
What Its Really Like In An 
Office 

Career Education i 

Career Exploration 
Clubs and Organlgatlona i 

Girls* Club Mothers' Tea 

Dlstrlbutlre Education t 

Job Interrlew 
Human Relations 
Matheaatlcs of Distribution 

English I 

Adrertlslng and Its Careers 
Gaining Information About 
Careers that Hatch Indlrl- 
dual Interests and Abilities 



New State Abbrerlatlons 
and ZIP Codes 



Producing a Mock Yearbook 



Search for Values 
Fire Steps of a Sale 



Choosing A Career 



History I 

Functional Democracy In The Classroom 
Home Economics I 



Exploring Careers In Home 
Economics 



Humanities! 



Your Enrlronment 
Job Visitations 



Career Day 

Exploring Job Opportunities 
In the Clothing and 
Textile Field 



Christmas In America 
(Sr. citizen party) 



Industrial Arts i 

Exploring Industrial Careers Working With Bricks and 
A Career In Architecture Mortar 
Construction of Comfort 
Stations for Orchard Use 

Journalism I 

Publishing Career Classroom News 
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Library I 

Preparing Catalog Cards 

Mathematics t 

Mathematics Requirements Consumer Math 

Related to Certain Careers Mathematics of Indirect 

Linear Measure 

Music I 

Career Possibilities in Music and Related Fields 

Photography I 

Photographic Occupational Opportunities 

Vocational Agriculture ! 

Agricultural Occupations Small Gas Engines 

and You Electrical Soldering 

Metal Working (Taps and 
Dies) 



Apart from career clusters and unit titles, d;ubject 
matter includ.ed a number of other elements of career educa- 
tion* These elements are Illustrated in Figure 5i Elements 
of Career Education-- Emphasis Chart. 



C» Project Ob^lectives and Instructional Aims. The 
Project ^s goals and objectives as found in the original 
proposal and amended goals and objectives are as follows i 

Purpose 

The purpose of this project Is to establish a comprehen- 
sive program of career education {K-l4) in three small economi- 
cally disadvantaged communities. The objectives of the project 
are intended to meet the needs of all children serviced by the 
local education agencies (LEA) relevant to career education 
and orientation, vocational work experience and cooperative 
eduoationt and vocational guidance and counseling. Further, 
the Intent of this project Is to provide a model with salient 
, features that have both transportability and Impact throughout 
the state of Washington. 

Project Amended Ob j ectives 

» 

The broad objectives of the project as stated in the 
approved research proposal and as contained in the project's 
amended objectives are as follows i 

1. To establish a comprehensive program of career 
education (K-l4) in three small economically 
disadvantaged communities • 
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Figure 5 

CASHMERE , PESHASTIN-DRYDEN 
CAREER EDUCATION PROJECT 

ELEMENTS OF CAREER EDUCATION— EMPHASIS CHART 
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A# The proflcram involve every student 

serviced by the LEA in a program designed 
to increase awareness of the world of work — 
the kinds of work people do, the tools they 
use, and the skills involved, and to formulate 
favorable attitudes regarding the dignity and 
status of all work, 

(1) The program at the elementary » middle, and 
high school levels will increase student 
awareness of the range of options open to 
them today in the world of work and to 
probable future changes caused by continued 
technological advancsments^ 

(2) The program will, at the elementary level, 
stress increased career awareness of students 
in terms of the broad range of options open 
to them in the world of work* 

(3) The program will, at the junior high or 
middle school level, provide career orienta- 
tion and meaningful exploratory experiences 
for students, 

(4) The program will, at grade levels 10 through 
1^, provide Job preparations in a wide variety 
of occupational areas, with special emphasis 
on the utilization of work experience and 
cooperative education opportunities for all 
students* 

(5) To expose students to a variety of occupa- 
tions, to inform them of occupational require- 
ments, and, where possible, to involve students 
in cooperative occupational programs and/or 
laboratory experiences. Also, where possible p 
to enable students to observe on the Job 
performance, 

B, The program will develop techniques, procedures, 
and materials which complement rather than supplant 
the existing school curriculum. These processes 
and products will be carefully evaluated as to 
both appropriateness and efficiency, 

C, The program will collect and utilize experiences, 
data and materials from existing career awareness 
programs throu/^^hout the State and the nation. 
These techniques, procedures, and materials vill 
be chosen so that they complement rather th8tn 
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•upplant the existing school eurr leu lam* These 
processes and products will be carefully evaluated 
as to both appropriateness and efficiency. 

D. The program will Involve the entire LEA staff In 
an intensive in-service program designed specifi- 
cally to carry impact to every student in every 
classroom. The in-service experience will involve 
each staff member with materials and experiences 
designed to increase awareness of the world of 
work, to formulate favorable attitudes regarding 
the dignity and status of all work? to gamer 
commitment to the program? to facilitate the 
instructional role of each staff member t and to 
facilitate the counseling and evaluative functions 
of each staff member* 



II. To counsel students in cooperative training experiences, 
Job placement opportunities, post-secondary occupational 
programs, and/or baccalaureate programs* 

A* The program will provide intensive vocational 
guidance and counseling assistance designed to 
Insure the placement of secondary and post- 
secondary students in either t (a) cooperative 
training experiences? (b) a Jobi (c) a post- 
secondary occupational program? or (d) a bacca- 
laureate program. This assistance will be 
availed to every student serviced by the LEA 
throughout the duration of the program. 

III. To disseminate program Informationt materials, and 
evaluative findings to agencies throughout the 
state of Washington. 

A. The program shall be a model program which can 
in effect be a clearing house for any community 
or agency wishing to gamer information and 
assistance in preparing a total program for 
career education (Krl^T. 

In addition to the above broad Intents and purposes, 
specific goal statements will continue to be aevelcped as a 
function of the project's operation from staff input and 
from assessed educational needs as delineated in the Intent 
of the project's research proposal. As such statements are 
Incorporated into the project's operational phase, they will 
be subject to the appropriate evaluative standards as adjudged 
necessary by the third-party evaluator and as specified in the 
Third Party Evaluation Plan. ^ 
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Beyond its broad skoals and objectives r the project 
utilized profcressional pcoal statements found in the 
National Standard Career Education Kodel « These &oal 
statements are found in Figure 6.^ 

It is important to note that project staff provided 
minimal restraints and limitations to individual teachers 
in the development of specific program activities and 
various interpretations of the project's goals and 
objectives* Project staff Instead provided resource assist- 
ance and consultation to the teaching staff* The result is 
that the project contained an extreme amount of diversity in 
its curriculum aims and objectives, A great deal of teacher 
involvement and a variety of interpretations concerning the 
direction of the project resulted. Simply put, the CEP program 
involved a massive effort by the staff of tno school districts 
to incorporate career education as a focal point In their day- 
to-day teaching. Rather than clarity and simplicity in design, 
the CEP program involved a multi-faceted approach wherein 
grade level specialists >^ere free to interpret the relevancy 
of career education to their specific grade level and subject 
area speciality. It was the continual domain of project staff 
to assist individual teachers with their efforts and provide 
overall resource assistance and continuity to program develop- 
ment. 



D, Instructional Procedures, Tactics » Materials , Once 
the CEP staff had been selected, assignments were divided 
into the areas of administration, curriculum, and guidance. 
Responsibility for the total program was that of the project 
director, Dr. Ronald Frye, The CEP staff began by collecting 
and evaluating data and materials from available state and 
national sources concerned with career education. From this 
material, techniques and procedures were selected which showed 
promise of being applicable to a small school situation. In- 
service workshops were conducted in three sections in the early 
stages of the project. The worlrshops involved 98 perceht of 
all certified teaching staff in the two districts and had as 
its purpose the preparation of staff members for developing 
units and Infusing career education concepts into the class- 
room. 

As a curriculum development project, minimal reliance 
was placed upon the purchase of equipment and materials to 
augment the CEP program. Instead, emphasis was placed upon 



The goals chart was prlnt»=5d with permission from 
Educational Properties Inc, P, 0, Box DX, Irvine, CA 9266^0 
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teacher Ideas and utilization of available community resources • 
Throughout the 1973-- 7^ school year, staff was involved with 
preparation of materials, procedures, arid practices, which 
would incorporate the concept of career education into the 
existing school curriculum/ Additionally, much attention was 
feiven to ways in which teachers might expand career awarenss 
beyond the experiential offerings of the local community. 

A detailed discussion of instructional procedures, 
tactics, and materials can be found in each of the project's 
curriculum guides. More information concerning this topic 
Will be found in the results of the formative evaluation 
described later in this report. 

By way of description, it is the opinion of the evaluator 
that the project was typified by many rich and varied instruc- 
tional procedures and methods. Prom the unit listings in the 
previous section, it is apparent that the scope of offerings 
were highly imaginative and indeed varied. So, too, appeared 
the type^ of activities and instructional procedures utilized 
throughout the course of the project. 

Perhaps the best illustration of the nature of instruc- 
tional procedures, tactics, and materials could be found In 
the "awareness" component of the CEP program. A major emphasis 
was placed by staff on fostering increased career awareness 
on the part of elementary students. This was attempted by 
allowing students an opportunity to become aware of occupations 
and the people involved in them. Particularly at the element/iry 
school level, extensive use of community resource persons was* 
evident. Such persons were not simply chosen at random, but. 
rather, were a highly organized cadre* representative of the 
various occupational clusters' In or around the Chelan County 
area (Including resource persons from Wenatchee). 

Also illustrative of the type and nature of instructional 
activities were the following types of activities i individual 
student projects, commercial films, commercial filmstrlps, 
teacher-made slide-tape presentations, cassette recordings, 
field trips (individual and group), classroom visitors, role 
playing, games, simulations, student readings, child-parent 
discussions, class reports, Indlvlclual Job exploration, etc. 
One unique program was the community exchange program whereby 
a number of elementary students had •'guests** from urban 
Seattle for one week and then, in turn, were themselves 
guests while visiting Seattle at a later date. 



E. Students and Co m munity Characterlsltlos . In accord- 
ance with the funding guidelines, it was the Intent from the 
project's onset to Involve all students of the Cashmere, 
Peshastln-Dryden school districts in the CEP program. Assess- 
ment of this intent will be found both in the formative and 
summative evaluation sections of this report. 
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The reader should understand that the communities In 
question feature homogenlety In population that -would not be 
found In most urban or suburban settings • The Cashmere 
School District has approximately 1100 students and, as a 
community, has traditionally supported its public schools 
quite favorably through passage of annual school levy 
measures and occasional bonds for capital improvements. The 
curriculum of the Cashmere School District is as varied as 
the district's limited enrollment mni resources will allow. 
The Cashmere School District has excellent school fAftlllties 
both at the elementary and senior high school levels, however, 
facilities at the Junior high school are less than ideal by 
any measure. The district's senior high school curriculum is 
notably strong in its vocational curriculum for a district 
of such small size. 

The Dryden community is located approximately eight miles 
from Cashmere and, together with the community of Peshastin 
(six miles beyond), operates a Joint school district with a 
student enrollment of 450 students. The Peshastin-Dryden 
School District has limited resources and, therefore, its 
facilities and curricular program cannot help but reflect 
sv.oh limitations. Curricular of f erlngs at the high school 
are quite narrow by comparison to Cashmere High School. In 
most instances, teachers at the high school level in 
Peshastin-Dryden are faced with teaching subjects in several 
unrelated areas. 

During the 1973-74 school year, voters of the Peshastin- 
Dryden district twice turned down a consolidation measure 
which would have Incorporated all three communities into a 
single «chcol dlstri<*-t. The consolidation failure caused an 
liasadlate problem for the CEP program in that both districts 
h^A operated under a single superintendent and the staff of 
both districts had highly favored the idea of consolidation. 
Despite any negative consequences of consolidation! failure, 
the CEP Tirogram remained as a central focus whereby continued 
cooperation and partnership remained between the two school 
districts. That the events of consolidation failure served 
as a handicap to the CEP program seems incontrovertible, 
however, there appears' no way which one could measure such 
contingencies. In fact, several staff members seeised quite 
defensive about the suggestion that events in any way had 
adversely affected the CEP effort. 



F. Standards » Basis for Judging Quality . In 
establishing criteria by which to Judge the CEP program 
several possible avenues for making one's Judgment exist • 
As in traditional research, formal evaluation piay deal with 
the measurement of specific objectives contained in a project 
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proposal. An example of such evaluative Information may be 
found In Chapters 3 and ^ of this report. 

Generally, objectives when they deal with student out- 
comes In reference to cognitive abilities and/or attitudes 
and behaviors are specified in the form of operational 
hypotheses. In order for statistical computation to be mean- 
ingfully Interpreted, such operational hypotheses are then 
formulated as null hypotheses by the researcher so that 
measurement of specific outcomes can be adjudged against a 
standard, in this case the •'accept'* or •'rejeef' logic of the 
null hypothesis. This report, Indeed, contains such procedures, 
but clearly there exists a need for additional standards 
beyond that of simply measuring whether or not the project 
achieved its objectives. 

Stake^ summarized the dilemma as follows: 

Informal evaluation tends to leave criteria 
unspecified. Formal evaluation is more specific. 
But it seems the more careful the evaluation, the 
fewer the criteria; and the more carefully the 
criteria are specified, the less the concern given 
to standards of acceptability. It is a great mis- 
fortune that the best trained evaluators have been 
looking at education with a microscope rather than 
with a panoramic vlewfinder. 

Stake goes on to say that research and evaluation 
today is Incapable of fully measuring the effect of any 
school or curriculum project because the methodology of 
processing judgments 1b inadequate. Not only is the method- 
ology Inadequate, but valid measurement is made extremely 
difficult due to the lack of other comparative standards. 

A further limitation in utilizing measurement techniques 
to determine the accomplishment of stated project objectives 
(as a determiner of quality) is the method in which such 
objectives were arrived at in the first place. Perhaps 
education Indeed is quite removed from being a science. For 
in a scientific endeavor the formulation of operational con- 
structs such as hypotheses would have been an extremely 
careful process with perhaps a slnpcle hypothesis measured 
for each separate experiment. In the educational context, 
however, as in the case of the CEP project, numerous goals 
and objectives exist ranging from stated project objectives 
to •'borrowed** goal statements elucidated in the National 
Standards for Career Education. - 



^Stake, loc. clt ♦ 

'National Standards for Career Education, loc. clt. 
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Earlier, vfhen descrlbln^^ the project •s goals and 
objectives (see Part C of this chapter) It was observed that 
the CEP program >had a rather global Intent In that goal 
statements were merely arrived at by restating guideline 
requirements g^ven to those wishing to make project applica- 
tion under Part C of Public Law 90-576. Beyond this, the 
CEP staff merely "adapted," In a rather pragmatic way, goal 
statements as contained In the literature ♦ Additional goals 
and objectives emerged as the CEP staff worked with Indivi- 
dual teachers who, In turn, had Interpreted the project in 
their own way. All of this, of course, demonstrates a lack 
of specificity and clarity in the establishment of goals and 
objectives for the CEP program. It is apparent that were this 
to be a scientific experiment, one would need to greatly 
criticize the above process and those Involved in the 
formulation of directions for the CEP program. It is the 
evaluator's opinion, however, that to do so would be merely 
an expression of frustration for a lack of sophistication" and 
methodology available to the researcher in assessing a program's 
overall worth. 

Increasingly, evaluators of educational programs today 
are more concerned with results of formative assessment as 
an indicator of standards by which a program should be 
adjudged. Such information on the inner workings of a program 
are meant to describe and assess processes and outcomes as 
they relate to the conduct of an educational program. Un- 
fortunately, when this is the only technique utilized for 
evaluation. It is entirely Inadequate. In many project reports 
utilizing only formative assessment, this type of evaluation 
is merely a "smoke screen*" Intended to obfuscate any meaning- 
ful overall Judgment of worth. 

A step further in establishing standards and a basis for 
Judging quality would be the comparative information of what 
is being done in other school districts and/or projects with 
similar parameters. If a project could Indeed by compared 
with counterpart projects through useful comparative criteria, 
then one would have an additional dimension whereby congruent 
standards of worth would be available. Since career education 
is a relatively new concept and since no such data collecting 
vehicle is available to the CEP program, other than a close 
look at several counterpart programs existing in the state of 
Washington, the reader must necessarily note this as an addi- 
tional limitation in determining standards and the basis for 
Judging quality. 

A final part of the evaluation process and one which in 
the final analysis is perhaps Just as valid as other indica- 
tors, is the overall Judgment of the various persons involved 
in the project as to the overall worth of the effort. Persons 
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In state offices of education often find efforts generated 
through Federal programs languishing a year or two aftei?' 
Federal funds have expired* One criteria for judging tHe . 
worth of a program, therefore, might be whether or not the 
effort is continued beyond Federal funding. Other criterion 
extant to this type of logic would be whether or not the 
local community feels the program was of significant merit 
and worth for the youngsters of the community* Additionally, 
one might well be concerned whether or not the students, 
teaching staff, administrative staff, and resource persons 
utilized in the conduct of the project feel that the overall 
effort was of value* Judgmental criteria already exists at 
the state level with the Coordinating Council for Occupa- 
tional Education which has decided to support a continuance 
of the CEP program for yet another year by other financial 
sources* Obviously, in deciding to continue elements of the 
project, the Coordinating Council had high regard for the 
Cashmere, Peshastin-Dryden Career Education Project* 

Beyond this and to those to whom salient features of 
the project have been disseminated through conferences, 
publlcatl6'il's , and visitations, rests an impression of over- 
all worth based upon numerous but Immeasurable standards* 
Last, but by no means least, are such impressions held by 
the evaluator who through adherence to the protocol of 
professionalism strives to be as objective as possible, but 
who, nevertheless, must have an overall impression as to the 
worth of the project* As one reads the pages that follow in 
this report, he or she must recognise that the standard or 
perspective from which one ad judges a program clearly pre- 
dicates what will be seen. Although clearly not feasible, 
perhaps the best approach for determining the overall quality 
of a program would be a consideration of all of the above* 

a'' 
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For some time noK, practitioners of educational 
research and development have used the term •'formative 
assesamGHf* to denote evaluation of that xhlch is done 
during a project's development. This type of evaluation 
is useful for those who are planning similar types of 
efforts and who are Interested in choosing the best ingre- 
dients or salient features from an already existing project. 
Significantly, curriculum developers, administrators, and 
teachers are often interested only- in information of this type 
when planning to Implement programs of their own* Formative" 
assessment is also useful in a program to be repeated in 
subsequent years. Formative evaluation, in effect, Xa 
intended to answer the question, "What Influenced the 
results of the project?** 

At Internal Evaluation, In the case of the CEP 
program, the approved project proposal states that ••internal 
evaluation would be the responsibility of the project 
director,** In this capacity, the project director prepared 
quarterly reports for the Washington State Coordinating 
Council for Occupational Education, In the very early 
stages of the project, the evaluator was asked to assist 
the project director in devising a discrepancy evaluation 
.model which would become an Integral and on-going part 
of the program (this is discussed in Chapter I of this 
report). Discrepancy evaluation procedures, then, were 
incorporated early in the project and it became a weekly 
part of staff meetings to continually assess and update 
staff members relative to the project's operational progress. 
Such a system is highly pragmatic in that it enables response 
to identified needs in a fairly rapid time frame as opposed 
to the amount of time needed in other more formal types of 
formative evaluation. 

S, Interim Evaluation, In addition to implementing 
on-golpg discrepancy evaluation techniques, ' the project 
director also asked the third-party evciuator that an 
independently-prepared interim evaluation report be prepared 
as an indication of progress at the project's mid-point. 
As a result of this request, the ^Program Interim Evalua- 
tion i Pror;ress Report" was prepared and presented by the 
evaluator to cover the period beginning June 1, 1973, and 
ending February 28, 197^, 

The Interim Evaluatlor; Report dealt with a summary 
of formative data concerning program design (intents) and 
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proRram operation (observations, antecedents, transactions). 
Also Included In the report was an analysis of the progress 
of the evaluation design and an analysis of the technical 
quality of the project's goals and objectives. Techniques 
used In the preparation of this report were varied and 
Included recorded Interviews, Interrogatories, questionnaires, 
and site visitations. The report enumerated several sub- 
stantive problem areas needing Immediate attention. Among 
such areas addressed In the Interim report werei the lack 
of specificity In goals and objectives, possible different 
focal points existing In the project due to differences In 
the two participating districts, the need to better monitor 
the accomplishment of objectives, and additionally a number 
of staff concerns related to the program's operation. 

In all, the Interim report Indicated most aspects of 
the CEP program as progressing nicely and, where problems 
were Indicated, staff showed "a minimum of def enslveness . 
In virtually every problem area noted In the Interim report 
the project has responded to evaluation findings and 
notable Improvement resulted In all Identified problem 
areas. The project Is to be commended for'^such response. 
The Interim report Is not being replicated In the appendix 
of this report In that It was Intended to be used by staff 
members only and was not to "pull any punches" but, rather, 
address significant areas of need as they existed at the 
project's mld-polnt. Granted, the actual Interim evaluation 
might be interesting to the reader, but the confidentiality 
ascribed to the interim evaluation process does not permit 
such indulgence. 

C> Staff Questionnaire. One essential way in which 
formative evaluation was conducted was through the use of 
a staff questionnaire administered June 3» 197^. The ques- 
tionnaire was administered to all certificated staff members 
of the Cashmere and Peshast in-Dryden school districts and was 
conducted solely and independently by the third-party evalu- 
ator. Staff members were requested to return the question- 
naire to the school secretary who then, in turn, checked the 
name off an accounting list and placed the completed ques- 
tionnaire in a sealed envelope. In this manner, the question- 
naire was kept completely confidential from district adminis- 
trators and to project personnel. 

Answers to a number of questions were soup^ht through 
use of the staff questionnaire. A number of the Important 
concerns were as follows j 

To what degree did staff participate in the CEP 
program? 

Was career education Infused into the existing curri- 
culum or was it treated as a separate subject area? 
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What were staff perceptions concerninp; student needs 

In reflcard to career education? 
What was. the role of counsellnp: In the CEP program? 
How effective has the proJect^s Inservlce program 

been? 

How well did the CEP program meet the expectations of* 

teaching staff? 
How effective did the staff feel the CEP program has 

been this year? 
Does staff plan to continue career education efforts 

beyond funding? 
How well have students responded to career education? 
What specific suggestions and comments did staff 

have' concerning the effectiveness of the career 

education project for the 1973-7^ school year? 

Table i lists the items used in the staff question- 
naire along with the results obtained. A questionnaire 
was returned by each staff member in both districts. 

Discussion , As can be seen from the responses to the 
first three questionnaire items , the degree of Involvement 
by staff varied as did the method of presenting subject 
matter dealing with career education. Despite the hope by 
CEP staff that "all teaching staff would participate in career 
education,** It was apparent that for one reason or another 
several staff members chose to participate only to a limited 
extent and in the case of two staff members, not to partici- 
pate at all. 

Question #2 tested an Important project objective 
concerning the Intent to "Infuse career education into the 
existing curriculum plan." The majority of staff (56 per- 
cent) did indicate that career education was presented corre- 
lated with other existing clas5?room subjects, still others 
(18 percent) stated they used social science as the main 
vehicle for inteprrating career education into the curriculum. 
Thirteen staff members (13 percent) stated they presented 
career education as a separate subject of major Importance. 
From item #2 it Is apparent that there were a variety of 
approaches to career education and that contrary to the Intent 
of project planners, only a slight majority of teachers 
presented career education correlated with other subject 
areas. 

The third questionnaire item dealt with whether or not 
local schools should be doing more or lass with career 
education. Response to this question showed that no staff 
member felt that th^ district should be doing less in 
career education. Conversely, 50 percent of staff felt that 
the district should be doing more in career education while 
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was adequate. 

Interestingly. Item ^5 showed that 85 ^^^^J^j;!!^ 
members felt that career education Is needed by all students 
rather than by any specialized category. 

is apparent that local staff felt the goals and objectives 
of career education sufficiently broad fo encompass the 
needs of all students. 

The next several questions dealt with the needs of 
youngsters.. Staff response was varied with the exception 
of Item #^ wherein most staff (89 percent) felt f ^ongly 
that thev were able to Identify potential dropouts before 
^hey physically leave school. Despite this, only 55 percent 
of staff indicated they had knowledge that their school was 
- presently making an effort to identify potential dropouts 
for special help (see item ^8). 

While item #12 demonstrated that staff opined counselors 
to be an important element in career education, several other 
items demonstrated that staff had mixed views as to the 
effectiveness and nature of the counseling component relatea 
to the CEP project. Item #11 did show that most frequently 
staff saw the primary role for counseling as belonging to 
the classroom teacher. 

Item #16 questioned whether schools do enough in teaching 
necessary skills to youngsters for entry into the world oi 
work.. Staff response was mixed with only one staff member 
feeling that the school presently does a sufficient Job of 
teaching such skills. The Importance of /o^^^lonal education 
and career «duo4tion in having complementary roles was stressed 
■with the response to ltem.#17 as 95 percent of staff indicated 
they do have complementary roles. 

Itfems #18. #19, and #20 went directly to the issue of 
the project's effectiveness in the eyes of teachers of the 
three school districts. Response was varied to the question 
concerning the effectiveness of inservice assistance (item #lo; 
Item #19 showed that the preponderant majority of staff gave 
positive marks to the career education staff in facilitating 
the overall program during the past school year. 

Item #25 shows that staff feels the local community 
as being essentially positive in regard to career education. 
Item #26 represented an important Item in that it questioned 
whether career education has complemented or detracted from 
the overall school prnprram this year. Notably, 3? percent 
indicated that it had complemented greatly the existing 
program while ^^5 percent found the CEP program somewhat 
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complementary. Only 9 percent found the program somewhat 
detracting and one staff member thou^^ht that the CEP 
program had greatly detracted from the school program. 

The question of whether staff would continue career 
education without Federal funding was asked In question 
#27 and 50 percent of staff Indicated that they would carry 
on to an even greater extent next year, while ^0 percent 
Indicated that they would give the same amount of effort 
next year. Only 3 percent Indicated they would not repeat 
and 7 percent Indicated that they had not yet made up their 
minds. 

Staff had mixed views as to the effectiveness of coor- 
dination for the career education effort this past year 
(Item #28). Item #29 Illustrated that 42 percent of the 
staff felt they had better student response with career 
education than with other subjects. Forty-five percent 
of the staff felt the response was the same as with other 
subjects. Only 4 percent of staff felt that students were 
uninterested In career education. Staff seemed quite un- 
certain as to student performance In career education as 
Illustrated through their own classroom evaluation. Perhaps 
Item #30 does nothing but show that teachers did relatively 
little formal evaluation of their career education effort 
this past year. 

Additional comments or concerns were solicited in the 
remainder of the questionnaire and a number of staff 
responded with some of the concerns Indicated in the para- 
phrased statements as follows: 

-Career education should not be Judged by an evaluator 
this year because this year has been merely a founda- 
tion. Future efforts will be much better. 

-Our goals for career education have been too broad. 
We had too little time and I am generally not satis- 
fied with what I have done. 

-There has been too little planning time. 

-The inservice program could have had considerable 
improvement. 

-This program has been a terrific asset to the local 
community and we only wish we had started this much 
earlier. 

-I didn't participate very much because no one asked 
me to. 



ERLC 



53 



^3 

-The project could have had better coordination. 

-Teachers spent too much on career education and 
neglected writing and reading skills. 

-I am unhappy about the salaries paid to CEP staff 
members and would have liked to have that money for 
my classroom. 

-Career education will fade Just as soon as the project 
is over. 



-I won*t make up my mind until I have read this year's 
evaluation report. 

In an earlier section of this report, it was stated that 
each person who evaluates sees a problem from a different 
perspectiva. It is apparent from the foregoing that staff 
does not speak with a single voice regarding career educatioij, 
but that essentially the majority of staff did find career 
education t6 be a highly profitable and worthwhile effort 
and that most viewed the CEP program with a high degree of 
support and positive regard. 

Pi "Strengths and Weaknesses" Questionnaire. An 
additional formative questionnaire was administered during 
the spring of the l973*-7^ school year by the project 
director. The questionnaire consisted simply of two open- 
ended questions concerning staff perceptions relative to 
career education's strengths and weaknesses* Approximately 
80 percent of staff members returned the questionnaire. 

When asked to indicate problem areas seen by staff in 
implementing career education, the following: represented 
some of the more common concerns: 



Impetus for career education must come from staff rather 
than from administration if it is to be successful. 

Special staff orientation sessions and Inservlce programs 
are needed to update staff in career education. 

There is Just simply too much to cover in career educa- 
tion and "better definition of scope and sequence is 
needed • 

Planning: time must be made available to teachers in 
order for career education to work. 



The community must oe informed as to the purpose of 
career education. 
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Career education is made more difficult by lar^e 
classes • 

Career education is more action oriented than other 
programs and must overcome teacher inertia since it 
does not depend upon textbooks. 

The cost of such a program is too high. 

Project funds have little effect at the classroom 
level. 

Career education needs to establish priorities rather 
than attempting; to be "all things to all people 

The other side of the coin was seen when staff was asked 
to relate the strengths of career education. They responded 
as follows I 

There is a high student Interest in career education. 

There is a great deal of relevancy in career education. 

A high level of motivation can be generated with this 
approach. 

The program fosters improved attitudes concerning all 
work. 

It develops a feeling of pride on the part of a young- 
ster. 

It is an enjoyable area for teachers and students alike. 

Career education creates very good public relations 
with tlie community. 

It may be the only means by which schools can keep up 

with a rapidly changing society. ■ - 

It shows students that there are more options open to 
them other than college. 

It can unite a staff and provide continuity to a 
curriculum. 

It fosters mastery of economic concepts which have 
heretofore been difficult to teach. 

It provides kids with alternatives. 
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It helps students realize that they are In charge of 
their own destiny. 

It allows students to comprehend skill arA training 
requirements for various types of work.- 

It creates a strong sense of cooperation between the 
school and resource persons who participate in the 
project > 

It can be the focal point around which an entire 
school district can be redirected and a new purpose for 
education can result - 

Students learn that there is dignity in all work and 
that people are more similar than they are different. 

It will allow life decision to be made in a more 
considered manner than in the past. 

E. Assessment of Community Involvement. Certainly one 
of the key elements in the CEP program was the degree of 
citizen involvement found in the three communities of 
Cashmere, Peshastin, and Dryden. The best indication of this 
is simply the number of local persons who served as resource 
to the CEP program. Virtually every local occupation was 
represented from the agricultural, business, labor industry, 
and governmental sectors. Nearly 100 citizens from the local 
communities were involved as "resource persons" representing 
some of the following occupations and businesses: 

Meat packer Tractor equipment operator 

Helicopter pilot Forest Service employee 

Dept. of Health & Employment agency official 

Welfare employee Fruit packers 

Druggist Radio announcer 
Military reprf santatives Orchardists 

Home economist Artist 

Tree grower Sewage treatment employee 

Clergy Karate and martial arts teacher 

Ecologist Fireman 

College professor Family planning counselor 

Highway patrolman Landscape architect 

State legislator Beauty salon operator 

Highway construction Stock broker 

worker - Candy manufacturer 

Home upholstery shop Instrument repairman 

owner Grocer 

Professional musician Banker 

Local sales clerks Police 
and others . . ♦ . 
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In many other ways, the CEP program depended upon 
community Involvement. Many activities of the project were 
held out of the classroom and In the community # Although 
the communities In question were small by any standards, It 
Is obvious that In even small communities there are 
tremendous resources when one considers the collective back- , 
grounds and experiences of citizens residing In the local 
community. 

Other aspects of community involvement occurred through- 
out the project and should be noted. Notable example of this 
Involvement was the Citizen Lay Advisory Committee for the 
career education project. Information regarding the forma- 
tion of this committee was circulated to service clubs, labor 
groups, civic organizations, agricultural associations, etc. 
From the resulting applications, nine persons were selected 
to represent a broad scope of the community! male and female, 
labor, agricultural, housewife, businessman, governmental 
employees, etc. The advisory committee was formed and the 
first meeting was held on August 29 1 1973 • Meetings were 
then held monthly thereafter and will continue next year 
during the 197^-75 school year. The general function of the 
committee was to act in an advisory capacity for the develop- 
ment of the career education program. Specifically, the 
committee served the following functions: (1) assisted in 
public understanding of the career education concept by 
acting as a liaison between school and community , (2) assisted 
staff by suggesting ways in which career education could be 
included into the established curriculum, (3) suggested places 
of employment where students could observe first-hand on-the- 
job performance, {^) suggested persons to be used as resource 
persons for classroom presentation. Information and guide- 
lines for the Citizen Lay Advisory Committee were reproduced 
in a booklet which received notoriety in the McGraw-Hill 
publication. Career Education News . 

Community involvement extended beyond the Advisory 
Committee into such groups as Cashmere Senior Citizens, 
Chamber of Commerce, private business, city and county 
government, local service clubs, and other groups including 
patrons of numerous Junior business projects, spaghetti 
feeds, and class projects. The support of the community 
for the concept of career education has been excellent in the 
case of the CEP program. The community sees the value of 
career education as aiding the existing educational program 
and thereby as beinp: of benefit to youngsters. Apart from 
the degree to which community involvement occurred, assess- 
ment of the quality of this involvement was the domain of the 
project director. It should be noted that as the third-party 
evaluator has interviewed a number of local persons relative 
to community Involvement, the positive outcome of this aspect 
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of the Drop:rani seemed well substantiated and Indeed community 
Involvement has been a highly- favorable aspect of the CEP 
program, 

F, Assessment of Dissemination. Objective III of the 
project proposal Indicated that the project was "to dissemi- 
nate program Information, materials, and evaluative findings 
to agencies throughout the State of Washington." The CEP 
staff has made a total of 5^ presentations to school systems, 
colleges, universities, workshops, and civic groups outside 
the Cashmere, Peshastln-Dryden area. These presentations 
have directly reached over 2^00 persons. Additionally; the 
project has entertained visitors from ^5 sohool districts 
from the State of Washington and numerous other persons 
from other educational agencies. To date, there have been 
several hunderd educators visit the project during the past 
school year. 

The project has seven publications which have been, 
made available to the public. Among publications are the 
following J Advisory Committee for Career Education i 
Career Education. What It Is. Who It Is For. W hy It Is 
Important } The Community College and Career Ed ucation; 
Career Education Curriculum Guide K-$ > Career Education Curri- 
culum Guide 6-8 } Career Education Curriculum Guide Senior High 
School, 9-12 ; Evaluation Report for the Cashm ere. Peshastln- 
Dryden Career Education Project . 

As was noted previously, the first publication. Advisory 
Committee for Career Education , has received national exposure 
through publication. The community college booklet mentioned 
above has been distributed to every community college campus 
In the' State and the career education pamphlet (the second 
publication listed above) has been sent to every first-class 
school district in the State. 

Beyond this, preliminary currlcular materials have been 
requested and sent* to approximately 200 school districts in 
• the United States. Other handout materials have also been 
sent or presented to persons visiting the project or handed 
out at presentations made to groups away from the .project. 

In addition to the above, CEP staff members this past 
year participated in six WAVE workshops held around the 
State of Washington, workshops were sponsored by the 
Washington State Coordinating Council for Occupational 
Education and were evaluated by CCOE's state guidance 
director, Mr. Ron Berg. The WAVE workshops (What About 
Vocational liducaltion?) were held throughout the year and 
provided a format through which various state career education 
projects could be disseminated to workshop participants. Each 
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workshop had approximately 30 persons In attendance and various 
State projects and ideas vere presented as the content of 
each workshop. The following, then, Is a summary of the 
evaluation conducted by the Washington State Coordinating 
Council for Occupational Education. Participants were asked 
to rate each project in terms of what had been most helpful 
to them. Figure 7 shows the mean score of grading as to which 
program presented in WAVE had been most effective in terms of 
presentation as viewed by conference participants t 

From Figure 7, it is apparent that the project very 
satisfactorily conducted a dissemination effort this past 
year in accordance with the expectations enumerated in the 
project's proposal. 

G. Costs. In determining the costs of transporting a 
currlcular program such as the CEP program only rough approxi- 
mations can be made in that this type of estimation Is highly 
subjective and would, of course, depend upon the particular 
situation of each district wishing to implement career educa- 
tion. With an enrollment of approximately 1550 students » the 
average cost per pupil for the CEP program was $89. ^^9. Since 
the program was also a research and development project t how- 
ever, it ifould be more meaningful to look at the various 
program components in determining an approximation of cost 
for transporting various operational elements. 

The project's curriculum component was budgeted to include 
personnel costs, travel costs, supplies and equipment t 
communication costs, and services such as the inservice 
program.. Total cost for this component was budgeted at 
562.00 and figured to an average per-pupil expendi- 
ture of ^28.75. Of this, however, personnel costs provided 
for approximately half of the expenditure. In looking at the 
problem of transportability, one would definitely need to 
determine his or her- personnel needs and only then could the 
cost of a career education program be approximated. 

Component B of the CEP program was the guidance and 
counseling component and budgeted under this were counseling 
personnel, travel, supplies and materials, communications, and 
services. The total budgeted for this component was .$32,7^2.00 
which represented a per-pupil expenditure of ^21.12. Againt 
roughly half of the expenditure for the guidance and counseling 
component was for personnel. 

Component C was project administration. This budget item 
Included personnel, travel, supplies and materials, communica- 
tions, and services. Total cost for this component was 
$5^,^98.00 which represented a per-pupil expenditure of 
$35.16. Of this amount, 89 percent went to project personnel. 
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The administration of the CEP proprram was necessarily a 
heavy cost item in that the project was a developmental 
program with responsibilities and purposes at all levels 
of the project and beyond to the State level. It also 
should be noted that project administrators were contracted 
for a l6-month period includinp; a planning period which 
took place prior to the bep:inninp: of the 1973-7^ school year. 
As the district sought to implement career education, it 
would be problematical as to whether or not such a propor- 
tion of funds should be allocated for administration. Many 
localities might perhaps choose to implement such a program 
with their existing administration or by hiring only minimal 
assistance. A^ain, estimation of cost in transportability 
would be contingent upon the needs of the implementing school 
district. 

Component D was the evaluation component budgeted at 
$6,906.00 which represented a per-pupil expenditure of $kA6. 
Evaluation was contracted to a third-party evaluator and the 
budget provided for services, benefits, and travel. 

It should also be noted that "in-kind" services were 
budgeted by the local school district for such services as 
space rental, office furniture, release time for local 
district employees, employee benefits, administration 
coordinator, ISD consultant, ISD migrant education specialist, 
etc. Local •'in-kind" contributions were $22,085.00 for a 
total per-pupil expenditure of ^1^.25. It should also be 
stated that "in-kind" contributions are usually approximated. 



A final note on cost is that each of the five schools 
participating in the CEP program were given discretionary 
Judgment over the budget for supplies for each of the 
buildings. Figure 8 below shows the amount budgeted for 
supplies along with the percent of students housed at each 
school location and the amount budgeted for building use. 



Figure 8 
BUDGET FOR SUPPLIES 



SCHOOL: 



Vale ^59 
Middle School 282 
High School 367 



28.7^ 
23.0% 



$ 3,157.00 
1,936.00 
2,530.00 



High School (PD)170 



10. 75^ 



1,177.00 



Peshastln- 



20.0% 



Dryden K-8 320 



2,200.00 
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The previous chapter dealt with ''what Influenced the 
results of the project?" The term "suimnatlve assessment- 
refers then to "what was accomplished In the project?" The 
most useful criteria in looking at what was intended, what 
influenced the results, and what were the results, is the 
cono:ruence between a project's intents and outcomes. More 
in keeping with traditional research and development* summa- 
tive assessment seeKs to measure student altitudes and know- 
ledge relative to the project's intents. 

One important limitation should be noted at the onset 
in that as was mentioned earlier in this report, the project 
was late In develor>lng its final curricular materials and 
concomitantly had a variety of diverse objectives with rather 
global intents. Despite the fact that these may be acceptable 
for a developmental program's first year of operation, it 
nevertheless poses a serious evaluation limitation. Due to 
the lack of specificity in both intent and design for the 
CEP program, evaluation of the attainment of specific objec- 
tives must be by approximation. In other words, rather than 
measuring specific behaviors delineated in the project's 
goals and objectives, the evaluation process seeks to estab- 
lish broad trends and behaviors as an approximation of the 
degree to which project objectives were attained. 

Since the project's broad goals and objectives as 
delineated in the project proposal call for growth in various 
areas of cognitive and affective development, a testing 
program was designed the the evaluator to establish various 
trend lines and indicators of accomplishment. Another__design 
limitation had to do with the fact that since the project 
was developmental and funded for only a single year's opera- 
tion, use of pre-test measures was made impossible as the 
program was yet to be developed. Instead, comparative 
measures used in the summative portion of the study were 
necessarily of a post-hoc design utilizing randomly selected 
experimental and control groups. 

*- 

For the purposes of the study, the control group was 
comprised of students from the Selah School District in 
Selah, Washington. The Selah School District, located near 
Yakima, has several characteristics In common with the 
Cashmere, Peshastin-Dryden area. The Selah schools service 
an agricultural community which is heavily involved with 
the fruit industry and is noted for its apples, pears, and 
various other agricultural comtmodities. As in Cashmere, 
the Selah community has several fruit packing plants and has 
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various small businesses In the community of a comparable 
nature to those found In Cashmere. Apart from the similari- 
ties, one notable difference exists between the communities 
in question in that Selah is situated adjacent to Yakima, 
Washington, which has a population of approximately 50,000 
people. The Selah community has approximately twice as many 
students as dees the Cashmere community and it is definitely 
less isolated in location. 

One final limitation in the summative portion of the study 
pertains to the lack of standardized criterion measures avail- 
able to the researcher as an indicator of career education 
attainment. As a consequence of this limitation, the evalua- 
tor designed most of the . instrumentation which follows. In 
each instance, various measures of reliability were obtained 
and reliability was sufficiently high with each instrument 
to warrant use. Additionally, construct validity should be 
notably strong in that for every grade level tested; consulta- 
tion between the evaluator and project staff was made prior 
to the testing program and whenever possible project materials 
served as the base of construct for specific instrumentation. 

Testing was conducted at each level from K-.12 and 
the chapter is organized according to the types of questions 
asked and the instrumentation used. This format roughly 
follows grade liiels sequencing from K-12. 

A. Career Awareness at the Primary Grades. In designing 
instrumentation for use at the primary grades, the evaluator 
sought a methodology which would not contain the disadvantages 
of a paper-and-pencll format. Obviously, the lack of mastery 
of reading skills with pupils of this ap:e group is a serious 
if not insurmountable burden to the researcher in designing 
a paper-and -pencil test. 

Instead of a paper-and-pencll format, then, a pictoral 
depiction of concepts in an individual test instrument 
utilizing an interview technique was designed. It should 
be added that the evaluator presented a paper on this tech- 
nique at the American Educational Research Association Con- 
vention at New Orleans in 1973. The technique involved con- , 
structlon of a career awareness pictoral inventory comprised 
of five sections including the followingt 

Part At Recognizing Occupations (all levels) 
Part B! Expanded Awareness (all levels) 
Part C: Parents* Occupations (all levels) 
Part D» Family, Home, and School (Kindergarten and first 
grade) 

Part Di Matchintr Tools and Symbols With Occupations 

Second and Third Grade) 
Part E: Family, Home, and School (Second and Third Grade) 
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For each p:rade level, Items were chosen from objectives 
contained In the National Standards for Career Education*^ 
and endorsed by the CEP proj^ram. 

Tests were administered on an Individual basis by a 
teams comprised of two persons. Each testing team consisted 
of the "questioner," whose Job was to ask the questions 
contained In the examiner's booklet. The second member of 
the team was the "recorder," whose Job was to record the 
responses of primary grade students on a provided score 
sheet. In all, six testing teams were used. Teams were 
selected from college seniors majoring In elementary 
education at Central Washington State College. Prior to 
test administration, each team conducted trial sessions at 
the Hebeler campus laboratory school at Central Washington 
State College. At this time. Inter-rater reliability coef- 
ficients were established for the various teams over common 
observations. In each Instance, an Inter-rater reliability 
coefficient of .85 or greater was obtained for those selected 
to do the necessary recording. 

There was a separate testing package prepared for each 
of the four primary grades (kindergarten through third grade). 
Plctoral depictions of various occupations were drawn by a 
professional artist. Depictions were simple and concepts 
associated with each occupation provided strong Inferential 
clues to respondents. The same testing teams were used In 
both school districts so that those who tested kindergarten 
students at Cashmere and Peshastln-Dryden also tested kinder- 
garten students at Selah. In this way, reliability In test 
presentations was Intended. 

A sample of 30 students at each grade level at each 
location (experimental group and control group) was used for 
test purposes. Subjects were selected at random from class 
rosters through the use of a table of random numbers. Each 
child was tested Individually. One member of the examining 
team walked to the student's room and asked the teacher for 
permission to take. that child. Each child was then escorted 
to a suitable room provided at each school location for test 
purposes. In kindergarten and first grade usually the child 
held hands with the member of the test team until they 
reached the testing room. In all Instances, rooms were com- 
pletely turned over for test purposes and no distractions, 
noise, or Interference occurred during the testing session. 
The examiner Introduced herself and attempted to put each 
child at ease with a friendly question or two abott what the 
child was wearing or the type of activity he or she was doing 
in school that day. As soon as the child was at ease, the 
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test session was begun and the standardized instructions as 
contained in the examiner's booklet were followed as con-- 
sistently as possible. 



KINDERGARTEN LEVEL RESULTS 

Part A . Part A of the kindergarten test consisted of 
a pictoral depiction of various school workers. The following 
occupations were depicted: teacher, Janitor, principal, 
secretary, counselor, cook, bus driver, nurse, and housewife 
or homemaker. All items depicted various school occupations 
with the exception of item #9 which depicted a homemakerr 
Each child was questioned by the examiner as follows: 

••This is a picture of a woman doing a Job 
at a school. What are people called who do this 
Job?" 

(if paraphrase is needed) 
••What is the name of the Job?** 

. • • If response is correct, say, ••Yes, (child's 
name), that's right. The woman is a teacher. 

. • • If response is not correct , say, "(Child's 
name), this person is a teacher. •• 

This technique was repeated for each item. 

Table 2 shows the results of Part A: Identification ox 
Occupational Roles for the Kindergarten LBVel. Note that 
the sample at each school district was selected at random 
and consisted of 30 kindergarteners. Test administrations 
were conducted for the experimental and control groups during 
the same week in the spring of 197^. Analysis consisted of 
a Chi Square contingency table based upon the frequency of 
response for three categories, "Yes,** "I don't know,*" and 
"Other. •• A Chi Square of 5^99 indicates significance at the 
.05 level of significance with two degrees of freedom. Only 
in the instance of item #6 (cook) was there a significant 
difference in the obtained Chi Square between the experi- 
mental and control ;2:roups. Inf erentially , however, there 
was a difference in the pattern of response between the 
experimental and control pcroups as can be seen upon exam- 
ininp: Table 2. 

Part B . The second portion of the kindergarten test 
sought to measure expanded awareness on the part of the 
child relative to selected occupational depictions. Rather 
than laboriously replicate results in their entirety, this 
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Table 2 



RESULTS OP THE CAREER AWARENESS PICTORAL INVENTORY i 
A TEST OF OCCUPATIONAL AWARENESS FOR THE 
PRIMARY GRADES 

Chi Square and Frequency of Response 
Part A I Identification of Occupational Roles 



Kindergarten 



Item 1 (Teacher) 

Cashmere, Peshastln-Dryden 

(N»30) 

Selah 

(Nrx30) 



Yes 



Item 2 (Janitor) 
Cashmere, Peshasfein-Dryden 
Selah 



19 
19 



I don't know 



12 

7 



5 
9 



7 



Other 



6 
2 



11 
19 



3.iif 



1^=4.27 



Item 3 (Principal) 
Cashmere , Peshast In-Dryd en 
Selah 



11 

11 



12 

16 



7 2 
3 



Item k (Secretary) 
Cashmere, Peshastln-Dryden 
Selah 



8 



13 
12 



Item 5 (Counselor) 
Cashmere, Peshastln-Dryden 
Selah 



0 
0 



15 
15 



15 
15 



c2= ^ 



ERIC 



^ computed at 2 degrees of freedom 

x2 of 4.60 significant at the .10 level of significance 
of 5.99 significant at the .05 level of significance 
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Yes 



I don't know 



Item 6 (Cook) 

Cashmere, Peshast In-Dryden 
Selah 



j 

Item 7 (Bus Driver) 

Cashmere, Peshast In-Dryden 

Selah 



Item 8 (Nurse) 

Cashmere, Peshastln-Dryden 

Selah 



21 
7 



22 
16 



22 
22 



Item 9 (Mother, housewife, homemaker) 
Cashmere, Peshastln-Dryden 5 
Selah 9 



1 

3 



0 

1 



0 
2 



0 

5 
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other 



8 



20 



8 
13 



8 



25 

16 



x2.l3.l'f 



x^^x. 2,28 



1.88 
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report will hi^hlip:ht only those Instances where a substantial 
difference was observed between performance of the experi- 
mental and control p^roup. 



Under expanded awareness, Item #5 asked, •^How does the 
teacher know If she does a good job?" Fifty-three percent 
of the Selah klnderp:arteners responded by saying, "I don't 
know." In all, there were five ways cited by Selah kinder- 
garteners In which teachers know whether they had done a 
good Job or not. Considerably more awareness was demons- 
trated on this item bj^ the Cashmere, Peshastln-Dryden young- 
sters as only three pupils responded by stating "I don't 
know" (10 percent). Additionally, youngsters from the 
experimental prroup cited 11 different ways in which teachers 
would know whether they had done a good job. 

Because of a desire to hold down the length of time 
needed to test each child, it was decided that questions 
concerning expanded awareness* would be only asked concerning 
the Job of teachers, rather than to seek answers to expanded 
awareness on each of the occupations depicted in Part A. It 
should be noted that those wishing to do further research 
in this area would perhaps find fertile ground in pursuing 
this investigation In that there does appear conceptual 
differences in favor of those who have received instruction 
in career awareness regarding indicators of task satisfaction 
in the adult working world. This represents a subject area, 
which apparently has beeh well covered in the CEP program 
at the kindergarten level. 

Part C: Parents^ Occupations . Part C consisted of a 
nuiTiber of questions pertaining to awareness of parental 
occupations. Item tfl in Irhis section asked, '•Do you know 
what your father does in his Job?" Fifty-six percent of the 
children in the control group (Selah) did , not know their 
father's occupation, whereas only 13 percent of the experi- 
mental group could not correctly answer this question. 

Incidentally, children were asked to specify the Jobs 
done by their fathers. The answer was counted incorrect^ 
if the child was unable to give any details. An example of 
this scoring decision was when a child would respond by 
saying, "My father works in Yakima." Upon further question- 
ing, it would be 'determined that the child could give no 
specifics about the Job, only that his "father works in 
Yakima." Thus, this response would be counted as an in- 
correct answer. 

Item ff3 questioned whether or not kindergarteners could 
tell whether their father's job helped people. Eighty 
percent of the children in the control group could not say 
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how their father's Job helped people* Subjects In the exper- 
imental ffroup, however, showed considerable awareness per- 
taining: to this Item as only 2? percent failed to respond 
to. this question. Children from the Cashmere, Peshastin- 
Dryden schools cited numerous ways In which Jobs were helping 
and, thus responding, they related many different aspects 
of Job performance, Job satisfaction, economic awareness, and 
aesthetic virtues • All of the aforementioned concepts 
represent abstractions which children In the control group 
were unable to clte» 

Item #7 queried as to whether or not the children knew 
what their mothers do In their Jobs. Again, considerable 
difference In awareness was demonstrated between the ex- 
perimental and control groups as 80 percent of the control 
group responded by saying, '•I don't know** or •'Ny mother 
doesn't worki " In contrast, kindergarteners In the experi- 
mental prroup demonstrated considerably more awareness In 
this area as only 23 percent of the sample responded by 
saying "I don't know'* or -My mother doesn't work!* 

Item ^9 asked, "How does your mother's Job help people?" 
It was noted responses of the experimental group were more 
fl;lven to listing specific details than duties of a mother's 
Job, while subjects In the control group (S61ah) dealt more 
with generalizations and affective statements such as "she 
cares for people" or "she loves us." Item #10 asked, "Why 
Is her Job an Important Job?" Again, responses of the 
experimental group Indicated more, variety In answers as 
ten different types of reasons were given while with the 
control group only two types of answers were received. 

Although the experimental group usually had many more 
reasons or specific details when pressed for answers, some 
responses were quite humorous. An example of this was 
frequently found in response to item #12 which asked, 
"Why does your mother work?" Frequently, answers were such 
as the following: "We would all die if she dldn'tl" "We 
would all starve to deathl " etc. 

Part D . Related to the child's family, home and school, 
item ^1 was centered around a picture of a family. Children 
were asked hypothetlcally , "How do members of this family 
help each other?" Again, only 37 percent of the control 
group could cite ways in which a family such as this would 
help one another. This is contrasted to only 13 percent 
of the experimental group who responded by stating "I don't 
know," Answers for the experimental group were more varied 
and they were specif ir. in citing types of tasks done at home. 
It was apparent that members of. the experimental group viewed 
such tasks as "vrork." 
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It^m ij In this section asked, "What Jobs do you have 
at home?" EliJchty percent of the control aroup said they had 
jobs, while 100 percent of the experimental c:roup indicated 
that they had Jobs at home. Apparently a different defini- 
tion was In operation between both groups as to what consti- 
tutes a "Job." Finally, item #6 in this section asked, "What 
Jobs would you like to have some day when you are older?** 
Children in the control P:roup cited ten occupational cate- 
fi:ories. Five children, however, indicated they planned sports 
careers and several p:ave Impractical occupations such as "ride 
a bike" or "play records," Klnderf2:arteners in the experi- 
mental fl:roup, however, cited 13 occupational categories with 
only child listing a sports career. Notably, occupations 
Aiven by the experimental group were much more practical 
than those cited by a control group. 

In summary, certainly results of kindergarten level 
testinsr would have to be termed inconclusive. There were 
several .strong Indications, however, that children in the 
experimental flcroup (Cashmere and Peshastln-Dryden) had 
benefited from the CEP program as obviously they possessed 
more awareness relative to certain areas of career awareness. 
Althoup-h this was demonstrated in some portions of the test 
to a greater degree than in others, it remains notable that 
in no area did children in the control group surpass the 
experimental group in response to any item . If nothing else, 
results of the kindergarten level test show that teachers 
did emphasize a number of points in the conduct of the career 
education proprram that are apparently not emphasized in a 
traditional or standard kindergarten classroom. 



FIRST GRADE LEVEL RESULTS 

Part A , The format and method of administration for the 
first flrrade level test was identical to that previously 
described for the kindergarten level, part A. Occupations 
depicted were as follows; teacher. Janitor, principal, 
secretary, counselor, cook, bus driver, nurse, mother (house- 
wife), fireman, baker, dentist, policeman and truck^ driver . 
Items I through 8 depleted school workers while items 9 
throuflrh 13 depicted several common occupations from the 
corarr/mlty. 

Table 3 shows the results of Part A: Identification of 
Occupational Roles for the First Grade Level. Aflrain, testing 
cor^isted nf randomly selected students in both the experi- 
mental trroup (Cashmere, Peshastin-Dryden) and the control 
c^roup (Selah). The N of each group was 30 and testing took 
place the same week In the spring of 197^* Analysis utilized 
a Chl Square Contlnflrency Table based upon the frequency of 
response for three categories, "Yes," "I don't knowt" and 
"Other." 
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Table 3 

RESULTS OF THE CAREER AWARENESS PICTORAL INVENTORY! 
A TEST OF OCCUPATIONAL AWARENESS FOR THE 
PRIMARY GRADES 

Chi Square and Frequency of Response 

Part A J Identification of Occupational Roles 



First Grade 



Yes 



Item 1 (Teacher) 

Cashmere, Peshast in-Dryden 

(N=30) 
Selah 

(N^30) 



2^^ 
23 ■ 



I don*t know 



Item 2 (Janitor) 
Cashmere, Peshastin-Dryden 
Selah 



23 
19 



3 



5 
3 



other 



x2= 0.l6 



x2= k.kB 



■ 8 



Item 3 (Principal) 
Cashmere, Peshastin-Dryden 
Selah 



Item ^ (Secretary) 
Cashmere, Peshastin-Dryden 
Selah 



16 
17 



16 
6 



11 
9 



10 
12 



12 



x2= 0.37 



x'^* 8.73 



Item 5 (Counselor) 
Cashmere, Peshastin-Dryden 
Selah 



0 
0 



20 



10 2 

X - 1.36 

6 



x'^^ computed at 2 degrees of freedom 

i2 of ^^.60 significant at the .10 level of significance 
O ^ of 5.99 significant at the .05 level of significance 
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Yes 



I don^t knox 



Item 6 (Cook) 

Cashmere, Peshastln-Dryden 
Selah 



20 
11 



Item 7 (Bus Driver) 
Cashmere, Peshastin-Dryden 
Selah 



28 
20 



Item 8 (Nurse) 

Cashmere, Peshastln-Dryden 

Selah 



25 



Item 9 (Mother, housewife, homemaker) 
Cashmere, Peshastln-Dryden 8 
Selah 15 



Item 10 (Fireman) 
Cashmere, Peshastln-Dryden 
Selah 



30 
26 



Item 11 (Baker) 

Cashmere, Peshastin-Dryden 

Selah 

Item 12 (Dentist) 
Cashmere, Peshastln-Dryden 
■Selah 



16 
11 



29 
2if 



Item 13 Policeman and Truck Driver) 
Cashmere, Peshastln-Dryden 2'f 
Selah 15 



1 

6 



0 
2 



1 
2 



6 

5 



0 

1 



1 

11 



0 
2 



1 

8 



62 
Other 



13 



8 



16 



10 



0 



13 
8 



x2= 6.91 



6.93 



x2= 0.85 



x2=r 3.61 



x2« If. 28 



c2=r.l0.if5 



X « ^,27 



x2= 7.85 
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A Chi Square value of 5*99 is siccnificant at the .05 
level of slprnlf Icance with 2 decrees of freedom* As can be 
observed In Table 3, a slprnlf leant difference between the 
experimental and control crroups were found on several items 
as follows: item ^, secretary (Chl Square -8.73) \ Item 6, 
cook (Chl Square r.6.91)j Item 7, Bus Driver (Chl Square = 
6.93); Item 11 » Baker (Chl Square = 10. k^); and item,..13f 
Policeman and Truck Driver (Chl Square =r ?»S5). There 
exists a slfl:nlflcant difference in the pattern of response 
between the experimental and control c:roups. It is assumed, 
therefore, that the CEP profl:ram, in deallnpr with various aspects 
of career awareness, contributed to this difference. In each 
.Instance of a slfl:nlf leant Chl Square, it was the experimental 
p;roup (Cashmere, Peshastln-Dryden) who out-performed the 
control p:roup. 

Part B « Technique and methodology for Part B: Expanded 
Awareness was identical to that described under Part B of the 
kindergarten test, A measure of student awareness relative 
to the occupation of teachlnp: was sought with six types of 
questions. Only those questions will be reported here that 
yielded a substantial difference in the experimental and 
control groups. Item asked, "When you see teachers working 
on their Jobs, what kinds of things do you see them doinff?*" 
Responses by subjects in the experimental Rroup indicated 
considerably more awareness of the various tasks necessary 
in doing the Job of teaching. The experimental group 
described eleven different types of tasks including several 
that were done without children present, such as correctlnp: 
homework and planning lessons. Children in the control 
group, however, cited only six different types of activities 
constituting: the Job of teaching- All activities cited were 
those directly visible by children rather than those occurring 
after school hours or those preparatory to classroom instruc- 
tion. 

Item #2 asked, "Can you tell me how this Job helps our 
school?" Eighty-three percent of those in the experimental 
group could describe in some detail how teaching is a help- 
ing role, whereas only 66 percent of those in the control 
group could respond in a similar manner. 

Item ^5 dealt with how a teacher would know if she is 
doing a pcood job. Answers oy children in the experimental 
group seemed more descriptive as 11 different types of 
indicators were mentioned, while only four types of indica- 
tors were mentioned by children in the control group. While 
only 13 percent of the experimental group could not answer 
this question, 33 percent of the control group failed to 
respond. 
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Item •^6 asked, •'Wou2:d-yt)U l-l^-e- to- do the teacher's _ 

job?" ?nterestln«iy. only 20 Percent of the control group 
indicated that "no" they would not like to do the teacher s 
i«h whereas exactly 50 percent of the experimental group 

Part C. v^ r.^r,t.^- occupations . As with the kindergarten 
test. Pirt C consisted ot a ^.umber of ^"""Sf ^^J^f jj"" 
to awareness of parental occupations. J'^" *1 "IJ*^^^?^ 
measure how many of e 'w Je'toSSed 

ro?rK '?nl5'Sh "ch id couW-jre'detalls of the Job 

SitMrr.enSre!..--^^ 

score sheet. Fifty-seven percent of JJ*^ ,°^ti™„H J?? „ 

only 40 percent responded by saying "no" or I don t Know. 

Item n asked for specifics on how the father's Job 
-.H J!ir> nponle Out of the 13 children who knew their 
would help people, vnz oi I'Mc j-^ „.^„„r> (<?pp nrevlous 
father's occupation from^he control '^^roup I see previous 
DaJaSaph). only seven could elaborate as to how their 
fSheJT ib helps people. This was In marked contrast to 
ihe pattern for ?he experimental group, as out of the 18 
chlld?e^ wSo Sew thei? father's occupations l6 could go 
nnio elaborate how their father's Job was of help to 
people!' ??em #5 ?n this series asked -^i^r-. 
father like his Job." Approximately one half of the 
chuSen in thi control g?oup didn't know the answer to this 

question, while all of the ^l^lie^^^ ^J^^^^^HIke Ms Job. 
Sroup Indicated "yes" their father Indeea did like his Jod. 

Question #6 asked "why does your 
to this question was quite similar for both SJ°"P^^*^ '„°;_ej. 
course, "money" was cited as the ^^^^\l?ZTonTlTso\ltlT 
a number of children in the experimental group also cited 
more abstract reasons in their responses. 

Item #7 pursued the previous line of questioning except 
hhflt nue^tlons pertained to the mother rather than to the 
?a?he? Response to item #7 Indicated that 40 percent of the 
chllS^n m the control group did not consider their mother 
to iave a job. while only 23 percent of the children in the 
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experimental Pcroup considered their mother not to have a 
Job, Response to Item '1^8 abstain showed considerably more 
awareness on the part of the children who had received career 
awareness Instruction* The question asked, •'What does your 
mother do on her Job?** Responses were much more extensive 
as children In the experimental P:roup cited 30 types of tasks 
while children In the control group only cited 19 different 
types of tasks. 

Part D » Part D of the first P:rade test pertained to 
family, home, and school. Responses pertained to a plctoral 
depiction of a hypothetical family in which children were 
asked to tell how members of the family helped each other. 
Forty percent of the control G:roup responded by saying, "I 
don't' know," while only ten percent of the experimental 
group responded In a like manner. Item 46 asked, **What Jobs 
would you like to have some day when you are older?" Child- 
ren in, the experimental group cited 15 different types of 
occupations while children in the control group cited 12 
different types of occupations. Less disparity was seen on 
this item than had been indicated in response to the same 
question for the kindergarten level. 

Although the first grade test indicated significant 
differences in a number of areas between the responses of 
children in the experimental ^3croup versus those In the 
control prroup, there also appeared a difference in response 
from grade level to Prrade level as answers to some of the 
same questions yielded entirely different types of answers 
and response patterns between kinderpcarteners and first 
graders as exemplified in the last item of Part D. Certainly 
th'^^ most fertile area of this aspect of the investigation 
pertained to the identification of plctoral depictions as 
found in Part A. The number of instances In which a signifi- 
cant difference existed between the experimental and control 
group in Part A should be noted by the reader. The evaluator 
must conclude that since all differences were in favor of the 
CEP project, credit again must be given to the Instructional 
component of ''career awareness" vrhich sought to deal with a 
subject area not traditionally covered in the first grade 
curriculum. 



SECOND GRADE LEVEL RESULTS 

Part A . ARain, similar to the format discussed In the 
previous two tests ( kinderp:arten and first pcrade levels), a 
like format was employed in testing career awareness for the 
second ^rade. Part A tested the following occupations i 
nurse, postman or mailman, store clerk, cashier or checker, 
secretary, carpenter, scientist, Janitor or custoriian, dru^r- 
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prist or pharmacist ♦ telephone lineman or repairman, mecHah'lc 
or auto mechanic, and baker. Table 4 Indicates the obtained 
Chi Square for the experimental and control groups. All 
subjects were randomly selected and testing occurred during 
the sanve week during the spring of 197^. From Table it 
can be seen that the following occupations yielded a signi- 
ficant difference between the experimental and control group? 
item ffl, nurse (Chi Square = 6.6?); item #8, Janitor or 
cusotdlan (Chi Square = 19.95) 5 ^and item #10, telephone 
lineman (Chi Square = 6.69). Were one to utilize the .10 
level of significance, several additional items would be 
included as having yielded a difference between the experi- 
mental and control groups. 

Part B . Part 3 sought to measure expanded awareness on 
a single chosen occupation (secretary). In contrast to 
differences found in this area at the kindergarten and .first 
grade levels, this area of questioning represented an 
unfertile line of inquiry as there failed to emerge a single 
item in which a substantial difference was found between the 
experimental and control groups. 

Part C . Part C consisted of a number of questions 
concerning parental occupations. Again, very little substan- 
tive difference was found between the experimental and control 
groups in this area. Item #6 asked, "Why does your father 
work?" It was noted that children from the experimental 
group cited more economic concepts in their responses . 
Additionally, some 17 percent of the control group responded 
by saying, "I don*t know," while only three percent of the 
experimental group failed to respond to this item. 

Item ¥7 questioned whether or not second graders 
perceived mother's work as being a job* Again, little 
difference was seen between the two groups except that 
20 percent of the Selah group responded by saying •'no- or 
'•I don't know," while only three percent of the children 
from the experimental group responded by saying ••no" or 
"I don't know." 

Item /S^IO asked, ''Why is her job an important Job?'* A 
slight reversal in expected differences was seen in this item 
as 17 percent of the experimental group responded by saying 
"I don't know," while only 10 percent of the control group 
answered in a like manner. Item #11, however, demonstrated 
a more familiar type of pattern as children were asked to 
indicate whether or not their mother liked her job. Only 
37 percent of the children from the control group indicated 
that they knew their mother liked her Job, while 70 percent 
of the experimental group indicated that they knew their 
mothers liked their jobs. 
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Table ^ 

RESULTS OF THE CAREER AWARENESS PICTORAL INVENTORY t 
A TEST OF OCCUPATIONAL AWARENESS FOR THE 
PRIMARY GRADES 

: Chi Square and Frequency of Response 

Part A» Identification of Occupational Roles 



Second Grade 



Yes 



I don't know 



Item 1 (Nurse) 

Cashmere, Peshast In-Dryden 

(N=30) 
Selah 
(N=30) 



30 
24 



Item 2 (Postman or mailsian) 
^Xashmere, Peshastln-Dryden 
■Selah 



2? 
26 



Item 3 (Farmer) 
Cashmere, Peshastln-Dryden 
Selah 



30 
28 



Item h (Store Clerk, Cashier, or Checker) 
Cashmere, Peshastln-Dryden 13 
Selah 7 



Item 5 (Secretary) 
Cashmere, Peshastln-Dryden 
Selah 



10 
10 



0 
2 



2 
3 



0 
0 



7 

11 



7 

11 



Other 



1 
1 



-2" • 



10 



12 



13 
9 



x2= 6.67 



0.22 



2.07 



r 



12^2'. 87 



X 5S 



1.62 
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X computed at 2 degrees of freedom 

x2 of k,60 significant at the .10 level of significance 
x2 of 5.99 significant at the .05 level^^f significance 
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------- 


Yes 


I don'-t know 


other - 


- 




Item 6 (Carpenter) 






16 






Cashmere, Peshastln-Dryden » 


9 


5 




1.93 


Selah 


5 




21 






Item 7 (Scientist) 












Cashmere, Peshastln-Dryden 


16 


10 






4.58 


Selah 


9 




10 






Item 8 (Janitor or Custodian) 












Cashmere, Peshastin-Dryden 




k 


2 


x2«l9.95 


Selah 


Q 

o 




17 






Item 9 (Druggist or Pharmacist) 












Cashmere, Peshastln-Dryden 


5 


11 


14 




5.65 


Selah 


0 


15 


15 






Item 10 (Telephone Lineman or Repairman, 


ijineman , or xowor 


Company 




worker) 












Cashmere, Peshastln-Dryden 


12 


7 


11 




6.69 


Selah 




A 


20 






Item 11 (Mechanic or Auto Mechanic) 










Cashmere, Peshastln-Dryden 


7 


9 


14 




5.31 


Selah 


1 


10 


19 






Item 12 (Baker) 












Cashmere, Peshastln-Dryden 


18 


0 


12 


2 

I at 


3.5^* 


Selah 


14 - 


3 


13 
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Part D. Part D dealt with matching tools and symbols 
with if^tlons. in administering this ^J^^' ^^^.^f ^^P^; 
f'.onni Clusters used In Part A were apialn replicated aionp: 
w ?h a sepl^a?e sit of randomly arrayed depictions of tool. 

„ K o? t-hP various represented occupations. Plctorwl 
Tevllfllls were prlsei?ed In'a seml-clrcle and children were 
fo'^tch'thrrooror symbol with Jhe depicted occupation by 
placing both pictures together. Table 5 P^J^®"^^ J^f^^J^ie 
this portion of the Investigation. As can be noted in Table 
5^ the meth^ of analysis consisted of a varlate t test 
of significance. A null hypothesis of no significant differ 
01 • ^. ^y.. Qt level of slp^nlf icance (with 

ence was tested at tne ^'^^ ^qq needed for 

2Q degrees of freedom an obtained t of l.W is neeaea loi 

>.oiPf.hPd From this can be seen that there is inaeea » 
Jfffe^ence be?ween the experimental and control -groups In 

'tieI?':Snity ro'Ltch tools and ^^f ol-,!^^?3°^^"^fea°?o; 

TinP of investigation represents a promising area lor 
fStSre SeseLch lrd should clearly suggest that Instruction 
In ca?ee? Iwarentss leads to significant gain in knowledge 
and skill relative to career awareness. 

Part E. The final section dealt with questions concern- 
ing tHffeihyrhome? and school and utilized a similar 
me?hodology as was described in parallel kindergarten and 
Jlrsfgrade level tests. Unfortunately, however, this area 
represented a less fertile area than expected and ^e^y little 
difference was seen in the responses between the experimental 
aid con??ol groups? Sne notable difference, however, was 
ana controj. ki<j"h'' jin which asked in reference to 

found in the response to item #7 V?,, " h ^o^p "Who works 
a hypothetical depiction of a family and home. ^^^^ 
harde? in this family-the mother or the father?" A major 
StffSenSe was seen In that only 13 percent of the control 
^iourtselaht indicated that the mother worked the harder. 

^ITll fo?'?he experimental group P--^^ ^J^J^J^^t^S' 
Indicated that the mother worked harder. An interesting 
Variance is seen in this item although the evaluator is not 
I?^n?ether su?e what Interpretation should be placed upon this 
. ?espSnse! ??em #lS asked. What Jobs would you like to have 
some div when you are older?" While children from Selah 
ns?e^ 12 df?fe?ent types of Job categories, some were quite 
un?eailstic such as "I want to drive a submarine" or "When 
r??oi up ? wint to be a bag boy." This was c^ontrasted to 
'17 d??fe?ent types of Job categories ^elng cited by the 
children in the experimental group combined with the lact 
^Jlat slemlSgly no Unreasonable Jo^/^^^'^orles were listed 
bv these children. Whether a valid question or not, it 
remains that cSudrcn who have benefited by career education 
seem to cite more varied occupational choices ^nd at the 
same time are less prone to cite unrealistic occupations. 
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Table 5 

FREQUENCY DISTRIBUTION AND UNTVARTATE t TEST 
OF SIGNIFICANCE FOR PART Di MATCHING 
TOOLS AND SYMBOLS WITH OCCUPATIONS 



Second Grade 



Occupations Depleted^ Nurse, Postman, Farmer, Cashier, 

Secretary, Carpenter, Scientist, 
Custodian, Druggist, Phone Repair- 
man, Auto Mechanic, Baker • 



Number of Cashmere, 
Correct Responses Peshastln-Dryden Selah 



12 


19 


14 


11 


2 


- 


10 


6 


6 


9 


1 


2 


8 


1 


1 


7 






6 




2 


5 










1 


3 




1 


2 




1 


1 






0 


1 


2 



N=30 N=30 

t=2.l59 

(t at 1.699 at the .05 level of significance needed for 
rejection) 

Fate: reject null hypothesis of no sl^?nlf leant difference 
between means 
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THIRD GRADE LEVEL RESULTS 

Part A . Ap;ain, the methodology was similar to the 
technique described previously. Part A sought to measure 
the identification of occupational roles. Table 6 shows 
several items as having a significant Chi Square. These 
items are as follows: item store clerk (Chi Square « 
7.5^) J item #9f druggist or pharmacist (Chi Square = 6»69); 
and item Ml2, baker (Chi Square = 8.32). 

Part 3 . Little difference in response for this line of 
questioning was observed between the experimental and control 
prroups Kith the exception of item #2 which asks, "Can you 
tell me how this Job (secretary) helps people?" Sixty per- 
cent of the control group responded by saying "I don't know," 
while ^7 percent of the experimental group responded in a 
like manner. 

Part C t Part C dealt with parents occupations and, 
again, this line of questioning was unfertile as there appeared 
no difference in the types of responses between the experi- 
mental and control groups. The role of maturation seems 
very much operant with the thlrci grade youngsters and the 
type of differences noted with previous grades simply appeared 
less often. 

Part D . Part D measured matching tools and symbols with 
occupations (Identical to the procedure used in the second 
grade test). Again, a univariate t test of significance was 
utilized in measuring differences between the experimental and 
control groups. As can be seen In Table 7, the obtained t was 
Insufficient to reject the null hypothesis of no significant 
difference between means. Therefore, there appears to be no 
difference in the ability of third graders to match tools 
and symbols with occupations. 

Part E . Part E also yielded little difference between 
the experimental and control groups with the exception of 
the response to item #2 which saw third graders in the experi- 
mental group listing 1^ different types of responsibilities 
held by children in the home, whereas subjects in the control 
group cited only seven different types of responsibilities 
in answering the same question. 



SUMMARY 

Overall, the evaluator was quite satisfied with the 
method of testing employe'^ at the primary level. It should 
be noted that thft purpose for this line of investigation was 
more of a "shotp^un approach" in that it seemed Impossible 
to d^t'^rmine from the project's goals and objectives with 
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Table 6 



RESULTS OP THE CAREER AWARENESS PICTORAL INVENTORY i 
A TEST OF OCCUPATIONAL AWARENESS FOR THE 
PRIMARY GRADES - 

Chi Square anci Frequency of Response 

Part A? Identification of Occupational Roles 



Third Grade 





Yes I d 


on't know Other 




Item 1 (Nurse) 










(N«30) 
(N«30) 


27 

2^ 


0 
3 


3 

3. 


x^. 3.18 


Item 2 (Postman or Mnllman) 










Cashmere , Peshastin-Dryden 


29 


0 


1 


i2« 3.02 


Selah 


28 


2 


0 




Item 3 (iParmer) 










Cashmere, Peshastln-Dryden 


30 


n 
U 


n ' 




Selah 


30 


0 


0 




Item ^ (Store Clerk, Cashier, 


or Checker) 








Cashmere, Peshastin-Dryden 


17 


3 


10 


x^' 7.5^+ 


Selah 


17 


10 


3 




Item 5 (Secretary) 










Cashmere , Peshastln-Dryden 


11 


3 


16 


5.83 


Selah 


13 


9 


8 




computed at 2 degrees 
of ^.60 significant at 
of 5.99 significant at 


of freedom 
the .10 level 
the .05 level 


of significance 
of significance 
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Yes I~^on*t know Other 

Item 6 (Carpenter) 

Cashmere, Peshastln-Dryden 17 4 9 

Selah 12 8- 10 

Item 7 (Scientist) 

Cashmere, Peshastln-Dryden 17 7 6 



2.25 



Selah 20 if 6 

Item .8 (Janitor or Custodian) 

Cashmere, Peshastln-Drydeh 23 ^ 3 

Selah - . ' 19 6 5 

Item 9 (Druggist or Ph«7Tn^clst) 

Cashmere, Peshastin-Dryden 4 ' 4 22 



x2« 1.06 



X^:* 1.28 



Selah 3 13 lif 

Item 10 (Telephone Lineman or Repairman, Lineman, or Power Company 
Worker) 



x^* 6.69 



Cashmere, Peshastln-Dryden 1^ 5 11 

Selah - 14 10 6 

Item 11 (Mechanic or Auto Mechanic) 

Cashmere, Peshaist In-Dry den 8 4 18 

Selah 11 9 10 



x2« 3.14 



i2=:4,68 



Item 12 (Baker) 

Cashmere, Peshastin-Dryden l4 0 16 

Selah 22 2 6 



8.32 
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Table ? 

FREQUENCY DISTRIBUTION AND UNIVARIATE t TEST 
OP SIGNIFICANCE FOR. PART Df MATCHING 
TOOLS AND SYMBOLS WITH OCCUPATIONS 



Third Grade 



Occupations Depicted »"■• Nurse, Postman, Farmer, Cashiei", 

Secretary, Carpenter, Scientist, 
Custodian, Drugjjist, Phone Repair- 
man, Auto Mechanic, Baker. 



Number of Cashmere, 

Correct Responses Peshastin-Dryden Selah 

12 20 15 

11 11 

10 2 7 

9 3 1 

8 3 2 

7 - - 2 

6 - 1 

5 - 

it - 1 



3 - - 

2.1 

1 _ - 

0 - - 

N=30" N=30 

t=1.066 

(t at 1.699 at the .05 level of significance needed 
for rejection) 

Fate I accept null hypothesis of no significant difference 
between means 
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any decree of certainty what specific skills and knowledges 
should have accrued to those experiencinc; career education. 
In seeking to establish various trends and indicators, it 
was apparent to the evaluator that the CEP project succeeded 
In numerous ways in establishinp: supremacy over traditional 
instruction relative to career awareness. Several conclusions 
seem warranted as follows: There is a statistically si;:^nifi- 
cant difference in favor of career education on several Indi- 
cators of career awareness.; expanded quest ioninc: yielded a 
number of notable differences in the types of responses with 
examiners concludinp; that children benefiting by instruction 
in career education do, indeed, show more awareness in a 
number of aspects concerning: the world of work; and a final 
conclusion was that readiness appears to be a factor as 
observed differences occurred betKeen responses by the 
experimental and control groups and also between the various 
grade levels. Certainly as the grade level increases, there 
appears naturally to be more career awareness. Perhaps the 
most siflrnif leant Rain to be found between the CEP program 
and a traditional program is found in the early grades. 



3. Project Questionnaire for Fourth Graders . Insofar 
as much of the evaluation was aimed at establishing broad 
trends and Indicators, It was not the purpose of the evaluator 
to create a questionnaire for every grade, The project 

staff, however, felt that they would like to have all grades 
involved to some degree In the testing program and so, there- 
fore, a questionnaire for fourth graders was designed and 
administered by the CEP staff • The questionnaire was admin- 
istered June 10, 197^ • and was given to each fourth grader 
in the Cashmere and Peshast in-Dryden school districts. The 
questionnaire was constructed from a similar instrument used 
in the 1973 Evaluation Report for the Helena Montana Career 
Education Program. Prior to summarizing some of the results, 
the evaluator should point out that the test appears to have 
serious construct validity weaknesses. Additionally, the 
advanced language and terminology used in the questionnaire 
leads one to doubt whether fourth graders could fully under- 
stand what was being asked. Another limitation is that the 
test is quite lengthy as it contains 38 items of a multiple 
choice and completion type. 

It would seem from the above that this test is of little 
or no value in aiding an understanding of the dimensions of 
the CEP program. Dasplte such limitations, the evaluator 
tabulated all questionnaires and the following represents 
some of the selected items along with the answers and 
percentages of response: 



ERLC 



86 



76 

Item fit Do you know v/hat you want to do when you 
flrraduate from hl^h school? Yes, 73^? No, 27%. 

Item ¥2i Do you have to p:o to collejre to p:et a p:ocd 
Job? Yes, 71^; Mo, 29*^ 

I 

Item rrj: Do you know what a trade school is? 
Yes, 21%; No, 79^. 

Item ^l6: Where would it be best to learn how 
to be a plumber? 

At a university, 18^ 

At a trade school, iSi^ 

At a business school, 23% 

Working? with a plumber, 

Item ^17; V/here would it be best to learn how to be 
a doctor: 

At a university, 37^ i 

At a trade school, &% 

At a business school, 21% 

V/orkinc: with a doctor, 3^-% 

Item t19: Where would it be best to learn how to 
be a barber? 

At a university, 15% 

At a trade school, 23% 

At a business school, 2^^% 

Workincr with a barber, 38^ 

Item ^20: Where would it be best to learn how to be 
a store clerk? 

At a university, 13% 

At a trade school, 21^ 

At a business schnol, 

Worklnp: with a store clerk, ^1% 

Item '^23 J Who or what would help you the most in 
decldinp* what job you mic:ht like to do? 

Your parents, 3^"^ 

Your teacher, l6i 

A book you read , H% 

Your hobbies, 38^ 

Item ;^28: Is it more important to earn a lot of 
money or to be happy working in a Job? 

Earn a lot of money, 15? 

Be happy workinpr, 85^ 

N^98 
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There were also several completion type items in which 
students indicated Job preferences, avocations, and community 
awareness. Results of the complete questionnaire were presented 
In detail to project staff for their consideration. Prom the 
data available, no overall conclusions concerninp: attainment 
of project objectives for the fourth pcrade level should be 
attempted. It does appear ^ however, that if one were to 
accept the face validity of the fourth Rrade questionnaire, 
then serious doubts as to the conceptual attainment of fourth 
traders would have to be raised (see above responses). The 
reader is to be cautioned, however, from making such an inter- 
pretation due to the aforementioned severe limitations of 
the fourth p:rade instrument. 



Ohio Work Values Inventory, Grades Five, Eight, and 
Eleven * Since one of the Pcoals of the project was to shape 
attitudes and values concerning the world of work, the evaluator 
soup:ht to establish trends and indicators concerning possible 
differences between value orientations of the experimental 
crroup (Cashmere and Peshast in~Dryden ) and the control p:roup 
(Selah). Since the intent of this dimension of the project 
was not clearly delineated in the project objectives, it 
seemed appropriate that a standardized measure be employed. 
For this purpose, the Ohio Work Values Inventory (OWVI), 
authored by Bradford J. Fenner and Loyde W, Hales, was 
utilized. 

The OWVI has an easy-to-use unfolding: booklet and 
consists of 77 multiple choice questions. According to the 
Spache Readability Formula, the OWVI -has a readlnp: level 
difficulty of /xrade 2*8 for comprehen-^ion* The test consists 
of 11 different measures as follows: Altruism, Object 
Orientation, Security, Control^ Self Realization, Independence, 
Money, Task Satisfaction, Solitude, Ideas-Data, and Prestige^ 
Test-retest reliability (alpha) of the Ohio Work Values 
Inventory ranp:e from the lowest grade level coefficient .77 
to a coefficient of •93» In addition, normative data is 
available for purposes of comparisons. There exists separate 
normative data and reliability fiirures for each grade level 
ranprlnp:- from P:rade 5 through 12. 

In takinpr the test, each student assesses his or her 
intensity of valuinp* for each item by selecting one of five 
possible answers. Responses are arranfred on a Likert-type 
scale with response choices beinPri Not Much , A Little , Fairly 
Much, A Lot , and Very Much . Each of the 77 items is designed 
to have a logical relationship v/lth one of eleven value 
constructs. 
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All subjects for both the experimental and control Pcroups 
w^ro randomly selected with the use of a t°ble of random 
numbers. A sample size for each <rrade lev<-l consisted of 
100 subjects (50 subjects each for the experimental and c^ricrol 
PToups). All inventories were administered during: the last 
week in May 197^. Subjects were provided with two pencils , 
and tests were administered by the evaluator and an* assistant 
in a separate testing; room at each school location. 

PlPTUres 8, 9, and 10 illustrate a comparison between 
the experimental and control p:roup for each of the three 
>rrades Involved in testlnpr. Scales reoresenced in the three 
ficcures are plotted accordina: to the attained mean scores 
for each p:roup. The results of individual students were 
reported to each of the school, as The Work Values Inventory 
Is intended for use by various hicrh school counselors, 
teachers, and career education staff members in assisting: the 
students to explore their work values and to tetter integrate 
their preferences into considerations of occupational possi- 
bilities. 

The reader should be cautioned that although an attitude 
scale such as the OVVI does yield a score, it should not be 
Interrreted in the manner one would interpret a test which 
has "rlKht" and "wronp;" answers. In other words, hlKh scores 
should not be interpreted as fl:ood and low scores as bad. What 
Is Intended in this evaluation report, however, is a deter- 
mination of whether or not the pattern of response to the 
O/ZVI v--i«d from the experimental P:roup (which had received 
instr ion in career education) to the control st.toup (which 
received no formal Instructional prop;rara in career education). 

Conclusion. As can be deduce'^ from an examination of 
the fifth ccrade and eleventh grade scores (see figures 8 
and 10) there does appear to be a noticeable difference on 
each frequency polygon for several of the categories in 
question. For one thinp-, both fic-'ires show students in the 
experimental group crivlng a higher rankinsc In each of the 
eleven categories. In a sense, i,t mirht be said that values 
were more positively oriented for this group. Although 
differences were not dramatic, it does appear that a notable 
Hfference can be seen on Object Orientation, Altruism, Money, 
and Prestige for the fifth grade saaple «nd ^n Independence 
for the eleventh c^ade sample. Whether or not one should 

^^^"^ -differences to the CEP program remains circur- 
spect, however, it is evident that there is a consistent 
difference between the experimental an-i control group and 
that subjects in the experimental group tended to value 
aspects of the n-rj hlrh.^-^ than did subjects in the control 
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From this line of investigation, the evaluator must 
conclude that results are less than conclusive regarding the 
significance of difference between value orientation for the 
experimental and control groups. It does appear that subjects 
in the fifth and eleventh grade participating in the CEP 
program xere more positively oriented than vere their counter- 
parts in Selah concerning the eleven categories tested In 
the OWVI, but results with the eighth grade appear to contra- 
dict any statement of differences between subjects* 



D. Supplemental Questionnaire to the Ohio Work Values 
Inventory^ Grade 11 , A supplemental questionnaire was 
administered to eleventh graders from the experimental and 
control group taking the Ohio Work Values Inventory, The 
purpose of this questionnaire was to determine possible 
differences between the experimental and control group 
concerning plans juniors might have relative to their future 
in the world of work. For purposes of reporting » only those 
items which yielded a difference are presented, 

D^lscussion * Results to item #2 of the supplemental 
questionnaire indicates slightly more positive orientation 
on the part of the experimental group concerning whether 
or not one could really expect the types of advantages 
preferred in the world or work. Item #3f again, showed a 
slightly more positive orientation on the part of experimental 
subjects relative to whether or not most adults are happy with- 
the Jobs they have. 

The fourth item concerned the relationship of a person ^ 
being happy in his or her work and whether or not she is 
happy in life. Differences in response are subtle for this 
particular item with the most notable difference occurring 
with the second and third alternative answers. Item #5 asked 
what career students plan to pursue after school graduation. 
Forty-five percent of the experimental sample listed the Job 
they intended to pursue after graduation, whereas 39 percent 
of the control group did the same. No major differences in 
listing occupations was noted. Apparently a slightly greater 
percentage of students from the experimental group had an 
idea of Job plans after' schooling is finished. 

The next several items dealt with student expectations 
concerning income, Job skills, and training required for 
specific Jobs, No notable difference was observed between 
the experimental and control group. Item #11 questioned 
whether or not students felt the school was doing an adequate 
Job of helpino; them to prepare Toif the world of work. Again, 
a subtle difference was noised between the experimental and 
control group with a slightly greater percentage of subjects 
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Table 8 

RESULTS OF SUPPLEMENTAL QUESTIONNAIRE TO 
OHIO WORK VALUES INVENTORY 



Item #2» Do you really think that you will be able to have 
the type of Job that has all of the advantages 
you like? 



Response 
Choices 


C. I 




Selah 


f 


-al— 


f 




les 


6 






.68 


Probably 




M 


■ 12 


.2^ 


Jncertain 






14 




Probably Not 


11 




1? 




No 


1 


.62 


2 


h-i^^ — 


Item #3« Are ra 


ost adults 1 


lappy with 1 


the Jobs the 


y have? 


Yes 


8 


.16 


if 


.08 


Probably 


■ 16 


.31 


11 


.22 


Uncertain 


1^ 


.2s 


13 


.2-? 


Probably Not 


11 


.22 


1| 


.31 . 


No 




.06 




.12 



Item Hovf Important would you rate the relationship of 



or no 


t he or she 


is happy in 


L life? 




The most impor- 
tant, outside 
of Kood health 


27 ^ . 


.53 


23 




Somewhat impor- 
tant, but other 
things are more 
important , such 
as earning a 
^ood living 


11 


• 22 


1^ 




Only average in 
importance , who 
you are is 
really the im- 
portant thinK 


12 


.2k 




.14 


Really not too 
important , 
having a good 
time and avoid- 
ing hassles Is 
really more 
important 


1 


.02 




.08 


Not important 
at all 


0 


.00 


0 


.00 
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Table 8 (continued) 



Item #5i W'hat career do you plan for yourself after your 
schooling is finished? 



Resnonse 
Choices 


C. P-D 


Selah 


I 




f 


« 12 


T Tpal 1 V don * is 
TAiTP Anv Id. 
yet 






19 




Item #11: Is s 
prepj 


chool doing 
are for the 


an adequate 
world of wc 


; Job of he! 
jrk? 


.ping you t 


res, It is 
helping quite 
a bltl 


11 


.22 


11 


.22 


It has helped 
somel 


1? 




12 


.24 


I*in not surel 


7 






.66 


I don't think 
It Is helping 
enouffhl 


8 


.16 


17 




^0, it hasn^t 
helped at all I 


8 


.16 


6 


.12 
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from the experimental group feeling more positive concerning 
the efforts of the schools 



E. Results of the Career Questionnaire for Grades SlXt 
Seven, Nine, and Ten t As with other summatlve measures, 
the Career Questionnaire was administered in the spring of 
197'^' to all students In the sixth, seventh, ninth, and 
tenth grades at the Cashmere and Peshastln-Dryden school 
districts. No Inter-group comparisons were Intended and, 
therefore, no detailed analysis will be presented. The 
questionnaire was adapted- from similar Instrument utilized 
In the Helena Montana Career Education Evaluation Report, 
1973-.7i^, Thgr tiuestlonnaire ^as administered at the suggestion 
of the project director in order to give project staff a 
reference to the Helena project. This type of comparison of 
results between projects is a technique often suggested in 
the literature. Persons wishing to make a rough comparison 
concerning student response to the line of questioning 
contained in the •'Career Questionnaire" are advised to obtain 
a copy of the Helena Montana Career Education Project Final 
Report. Table 9 Illustrates the questions asked along with 
the frequency of response and percentages for each item. 

In judging responses, information should be given 
concerning several items. Item #'3 asks whether or not 
Washington State has a state income tax. The reader should 
be advised that Washington does not have such a tax and, 
instead, assesses revenue on a property tax and sales tax 
basis. Item #6 refers to a vita useful for Job placement 
and item //9 assumes that students have thought of a career 
to follow. Item #9, therefore, is a rather spurious item 
considering results from previous questionnaires already 
discussed in this chapter. 

As meritorious as the project intent was in using the 
Career Questionnaire as a base of referencing results with 
those of the Helena project, it should be pointed out that 
this particular questionnaire suffers from a complete lack 
of construct validity. Insofar as the evaluator has deter- 
mined, very little, if any, of the subject matter covered 
in the Career Questionnaire had actually been presented 
in classroom instruction for the CEP program. It also 
should be mentioned again that the evaluator placed very 
little credence in this particular instrument in Judging 
the accomplishment of specific objectives. Certainly the 
limitation discussed previously pertaining to the fourth 
grade questionnaire are also applicable to the Career 
Questionnaire. 
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F. Senior Questionnaire . A senior questionnaire was 
prepared and administered by the CEP counselor concerning 
senior clas« member perceptions relative to future plans, 
Thm questionnaire was administered to all seniors in the 
Cashmere and Peshastin-Dryden schools (NkIO?). Item A 
asked, "What are your plans for the summer?** Of students 
indicating their summer plans, the following types of 
activities were listed (shown with frequency of response): 



Just work (10) 
Orchard work (23) 
Dry wall (1) 
Candy factory (1) 
Radio station (2) 
Waitress (4) 
Summer school (1) 
Alcoa (1) 
Mill ik) - 
Computer, programmer (1) 
Office work (5) 
Housewife (l) 
Seamstress (2 ) 
Power company (1) 
Tree Fruit Research 

Center (1) 
Construction ,(2) 
Fire fighting (1) 



Clerk (9) 

Nursery (1) 

Fruit warehouse (3) 

Nursing home (2) 

Painting (1) 

Drive-in restaurant (2) 

Cannery (1) 

City Hall (1) 

Frozen food warehouse (2) 

School maintenance (6) 

Carpentry (2) 

Travel (1) 

Medical office (2) 

Fishing boat (1) 

Logging (2) 

Forestry (1) 

Furniture store (1) 

Not sure (6) 



Item B asked, *'Do you plan to work in the fall?" Fifty- 
five percent responded by Indicating •'yes,'* 29 percent 
indicated "no," and 15 percent Indicated they were undecided^ 
Of those planning fall employment, 4? percent planned full- 
time employment and 53 percent part-time employment. Intended 
for the use of the counselor, this item also asked for details 
about specific work and Job locations. Also incorporated 
in the item was the question, "To what degree did each of 
the following influence your decision to do this work?" The 
following are the alternatives offered and the frequency of 
response obtained t 



NONE SOME 

Parents or relatlve(s) ^7 

Teacher(s) 20 

Counselor 9 

Other students 38 

Guest speakers 17 

Field trips ^ 

TV, newspapers, magazines 10 

Class subjects 21 

Classroom career study unlt(s) l6 

. Other ^ 



A LOT 
25 
3 
5 
9 
2 

3 
6 

5 
6 
2^ 
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Item C asked for Ipng-range caraer goals and the 
following types of answers were obtained along with the 
frequency of response t 



General contractor (1) 
Lineman (1) 
Apparel designer (1) 
Electronic technician {2) 
A trade (1) 
Salesman (1) 
Commercial pilot (1) 
Business management (2) 
Journalism (1) 
Elementary music tchr.(2) 
Teacher & coach (1) 
Law enforcement (1) 
Teacher (2) 
Not sure (9) 
Biologist (1) 
Registered nurse (6) 
Dancer (1) 
Veterinarian (2) 
Medical field (3) 
None (3) 
Office work (4) 
Teach college P. £• (1) 
Coach girls' sports (1) 
Electrician (2) 
Banking (1) 
To be independent (1) 
Housewife (11) 
Christian worker (1) 
Cook (1) 

Forestry 



Solanoe teacher (1) 

Mechanic (2) 

Stewardess (2 ) 

Horticulturist (2) 

Public defender (1) 

X-ray technician (1) 

Military (l") 

College teaching (1) 

Electrical engineering (1) 

Marine biologist (1) 

Ag teacher (2) 

Industrial arts teacher (1) 

Civil Service (1) 

Teacher of Deaf and Mute (1) 

Public relations (1) 

Real estate work (1) 

Bio-medical engineer (1) 

Science field (1) 

Machinist (3) 

Business field (1) 

P. E. teacher and coach (1) 

C, P, A. (3) 

Lawyer (1) 

Architect (1) 

Physical therapy (2) 

Elementary teacher (1) 

Dental hyglenist (1) 

Pilot (2) 

Construction management (1) 

(2) 



Item D asked, •^What are your educational plans after 
high school?** Response to this item, along with frequency 
of response, is offered aS' follows i 



NEI (1) 

Air Force training (2) 
E.W-S.C. (3) 

Wenatchee Valley College 



J. M» Perry Institute (1) 
Grays Harbor C. C. (1) 
W.S.U. (9) 



British Columbia Bible Institute (1) 
Olympic C. C. (1) Spokane Falls C. C, (l) 

Baptist Institute (1) C.W.S.C. (3) 
W.W.S.C. (2) University of Washington (4) 

Portland School of Electronics (1) 



Navy training (1) 
Harding College (1) 
Yakima Valley College 
Big Bend C. C. (1) 
Not sure (6) 



Columbia Basin C. C* (3) 
B.y.U. (2) 
(1) Letness Aviation School 
Trade school (1) 
College (2) 
None (5) 



(1) 
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As a result of the preceding comprehensive evaluation, 
a number of conclusions concerning the CEP program can be 
forwarded* These conclusions are as follows t 



FORMATIVE JUDGMENTS 

!• The CEP program demonstrated merit in a number of 
aspects emphasized in the formative assessment • 
The program ably incorporated a discrepancy evalua- 
tion format which allowed staff to continually assess 
and update the program in response to identified 
needs. 

2» An interim evaluation report was conducted by the 
independent evaluator and a number of technical 
concerns were enumerated* The project is to be 
credited for responding to each of the concerns 
identified in the interim report* 

3* Formative evaluation also incorporated use of a staff 
questionnaire which, in general, found the majority 
of staff holding the opinion that the career educa- 
tion project was a highly profitable and worthwhile 
effort and that most viewed the CEP program with a 
high degree of support and positive regard* Addi- 
tional measures seeking to determine staff input 
were also discussed in the chapter on formative 
assessment* 

4e One measure of the strength of the CEP program was 
the community involvement In the project* Not only 
wats there significant participation by community 
resource persons, but there also existed rich and 
varied activities throughout the project* Community 
Involvement was exemplified by the citizens* advisory 
committee and beyond to such groups as local service 
clubs, businessmen, senior citizens, and other patrons 
of the local school district. 

5# Formative assessment results highlighted the role 
of dissemination in the CEP program* This aspect 
of the project vas perhaps one of the strongest in 
* the entire program as impact of CEP reached 
throughout the state of Washington and beyond* Six 
publications resulted from dissemination efforts 
with several receiving national distribution and 
notoriety* 
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6. The CEP program was well received throughout the 
state as evaluation of state-sponsored WAVE work- 
shops showed the project to be the most helpful to 
those who attended these sessions* 

?• Costs of transporting the CEP program were estimated. 
Apart from funds spent for staff salaries and admin- 
istration^ the CEP program would be of marginal 
expense to Implement elsewhere » 



SUMMATIVE JUDGMENTS 



8# Results of summatlve assessment indicated that career 
awareness at the primary grades (K-3) was a very 
strong element in the overall project. In conducting 
the summatlve assessment at the primary level, a 
post-hoc design utilizing a randomly selected experi- 
mental and control group was utilized. In a number 
of instances, a statistically significant difference 
in favor of the CEP program was reported. Since 
procedures utilized careful research methodology, 
results seemed encouraging* It did appear, however, 
that as the grade level increased, differences 
between the experimental and control group aeemed 
less apparent, raising the possibility that ''career 
awareness" might be a consequence of maturation and 
readiness even without instructional efforts such 
ad thd CEP program* 

9» Summatlve Instrumentation souf;ht to determine 

differences in value orientation between students 
from the experimental and control group populations. 
For two of the three grades tested, notable differences 
in value orientations were observed with the experi- 
mental subjects showing a more positive value 
orientation, 

10, Eleventh graders were questioned concerning specific 
plans they had concerning the world of work. Only 
subtle differences In attitudes between the experi- 
mental and control group emerg;©*.- at this age level, 

11, A number of additional suMmative measures were admin- 
istered as a part of the project's evaluation. 
Results for most of these Instruments proved Incon- 
clusive, 
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JUDGMENTS OF WORTH 

The project's Intents and their outcomes were as 
follows: 

k. To Increase student awareness of the range of 

options open to them and to probable future changes 
In the world of work* 

Result I Indetermlnant* Summatlve assessment failed 
to demonstrate clearly that CEP students had any 
more awareness regarding the range of options open 
to them today and to probable future changes in the 
world of workt 

B* To Increase th^ self-awareness of each student, 

modify attitudes about personal, social, and economic 
significance of work and to assist students in 
developing appropriate decision-making skills. 

Result : Indetermlnant • Aspects of this Intent 
were probably accomplished^ particularly in reference 
to awareness of students at the primary level. 
Additionally, the value orientation of older students 
also seemed significantly Influenced by career 
education. Whether or not decision-making skills 
were significantly altered as a result of the project 
was nowhere demonstrated. 

C. Stress career awareness at the elementary level. 

Result: Successful. Results of both formative and 
summative assessment support the conclusion that 
this intent of the project was accomplished, parti- 
cularly in reference to primary grades. 

D. Provide at the Junior high or middle school level 
career orientation and exploratory experiences. 

Result: Successful. Formative and summative assess-* 
ment measures both tend to corroborate that orienta- 
tion and exploratory experiences were a successful 
component of the project. It should be noted that 
there was perhaps Just as many successful orientation 
and exploratory experiences with earlier grades as 
with middle school youngsters. 

E. To expose studencs to a variety of occupations, to 
Inform them of occupational requirements and, where 
possible. Involve students in cooperative occupa- 
tional programs and/or laboratory experiences. Also, 

^ where possible, to enable students to observe on-the- 
job performance. 

Er|c //5^ 
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Result J Suooaasful^ The degree of community In- 
volvement and the types of activities undertaken in 
pursuit of this Intent were hlghllght*ed In both the 
formative and the summatlve assessments. Utilization 
of community resources was pcirhaps the' strongest 
aspect of this Intent while Involvement of students 
in cooperative occupational programs and/or labora- 
tory experiences was perhaps the least successful 
element • 

Develop techniques » procedures ^ and materials which 
complement existing curriculum • 

Result t Successful, Project materials were rich 
and varied and emphasized staff ideas and talents. 
Most staff felt that the CEP program complemented 
the existing curriculum as discussed in the chapter 
on formative assessment* 

Collect and utilize experiences, data, and materials 
frcMn existing curriculum. 

Result I Successful* Formative assessment tended to 
corroborate accomplishment of this Intent. 

Involve all staff members in an in-service training 
program aimed toward career education. 

Result I Successful. Staff was deeply Involved in 
in-service training with only a few exceptions. 

To counsel students toward opportunities available 
to them after completion of high school. 

Result t Indetermlnant . The counseling component 
was of considerable concern to project staff through- 
out the conduct of the project in that the original 
intent was that the counseling component would work 
directly with students in a manner similar to tradi- 
tional vocational and academic counseling. In 
reality, however, little of this type of counseling 
was done by the CEP staff despite there being a 
very competent counselor on the CEP team. Instead, 
the counseling component operated as a part of the 
curriculum effort and the Intent was to upgrade the 
skills of individual teachers concerning the counseling 
function. A lack of coordination between the CEP 
program and existing counselors at the two school 
districts was a decided weakness in reference to the 
intent of the project. 
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J. To disseminate information and materials to educe.' 
tional agencies within the state and nation. 

Resultj Successful, Results of formative assess 
ment tends to corroborate that this was ft highly 
successful part of the CEP program. 



Co nclusion . The reader is cautioned against a casual 
T-eading of this document and, in particular, of this chapter. 
The evaluation effort involved a concerted effort to assess 
the overall worth of the program throughout the duration of 
the project's operation. It Is the opinion of the indepen- 
dent evaluator that the CEP program was exemplary in many 
regards and that it accomplished a number of stated intents 
as well as having resulted in numerous unanticipated benefits. 
The urogram was well managed and was quite ^"^J;:!!:"^ 
available the services of a competent and enthusiastic staff. 
Perhaps most significant in the CEP effort is that a project 
of such quality could emerge from three rural disadvantaged 
communities having marginal resources from which to draw. 
Undoubtedly a very significant positive impact resulted 
from "Federal funding. 
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